2023-07-20 23:10:13,795 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 23:10:14,052 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee 2023-07-20 23:10:14,052 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-20 23:10:14,053 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-20 23:10:14,093 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 23:10:14,341 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 23:10:14,342 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c, deleteOnExit=true 2023-07-20 23:10:14,342 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 23:10:14,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/test.cache.data in system properties and HBase conf 2023-07-20 23:10:14,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 23:10:14,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop.log.dir in system properties and HBase conf 2023-07-20 23:10:14,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 23:10:14,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 23:10:14,345 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 23:10:14,721 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 23:10:14,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:14,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:14,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 23:10:14,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:14,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 23:10:14,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 23:10:14,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:14,727 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:14,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 23:10:14,728 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/nfs.dump.dir in system properties and HBase conf 2023-07-20 23:10:14,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir in system properties and HBase conf 2023-07-20 23:10:14,729 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:14,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 23:10:14,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 23:10:15,359 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 23:10:15,363 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 23:10:15,646 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 23:10:15,825 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 23:10:15,842 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:15,883 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:15,921 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_localhost_38391_hdfs____.as3rkg/webapp 2023-07-20 23:10:16,084 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38391 2023-07-20 23:10:16,128 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 23:10:16,128 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 23:10:16,744 WARN [Listener at localhost/33859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:16,846 WARN [Listener at localhost/33859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:16,872 WARN [Listener at localhost/33859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:16,881 INFO [Listener at localhost/33859] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:16,889 INFO [Listener at localhost/33859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_localhost_46593_datanode____.2nyn2k/webapp 2023-07-20 23:10:17,028 INFO [Listener at localhost/33859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46593 2023-07-20 23:10:17,584 WARN [Listener at localhost/35919] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:17,636 WARN [Listener at localhost/35919] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:17,640 WARN [Listener at localhost/35919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:17,641 INFO [Listener at localhost/35919] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:17,646 INFO [Listener at localhost/35919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_localhost_36943_datanode____.pkp84k/webapp 2023-07-20 23:10:17,772 INFO [Listener at localhost/35919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36943 2023-07-20 23:10:17,786 WARN [Listener at localhost/34923] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:17,827 WARN [Listener at localhost/34923] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 23:10:17,831 WARN [Listener at localhost/34923] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:17,833 INFO [Listener at localhost/34923] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:17,843 INFO [Listener at localhost/34923] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_localhost_37729_datanode____.p8rxvj/webapp 2023-07-20 23:10:17,996 INFO [Listener at localhost/34923] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37729 2023-07-20 23:10:18,014 WARN [Listener at localhost/40933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 23:10:18,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62902e01343129f4: Processing first storage report for DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d from datanode 84c623c4-2f76-44da-9e2f-f864d52de778 2023-07-20 23:10:18,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62902e01343129f4: from storage DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d node DatanodeRegistration(127.0.0.1:44315, datanodeUuid=84c623c4-2f76-44da-9e2f-f864d52de778, infoPort=45255, infoSecurePort=0, ipcPort=35919, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9bb5502a1c009b3: Processing first storage report for DS-a345d78c-f445-45b5-a17c-7c30abb04205 from datanode c3029a52-7b03-4f0f-a252-206a22a5741f 2023-07-20 23:10:18,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9bb5502a1c009b3: from storage DS-a345d78c-f445-45b5-a17c-7c30abb04205 node DatanodeRegistration(127.0.0.1:35613, datanodeUuid=c3029a52-7b03-4f0f-a252-206a22a5741f, infoPort=35083, infoSecurePort=0, ipcPort=34923, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x62902e01343129f4: Processing first storage report for DS-75edbb84-9ff1-45cd-8b5c-4df46e511ceb from datanode 84c623c4-2f76-44da-9e2f-f864d52de778 2023-07-20 23:10:18,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x62902e01343129f4: from storage DS-75edbb84-9ff1-45cd-8b5c-4df46e511ceb node DatanodeRegistration(127.0.0.1:44315, datanodeUuid=84c623c4-2f76-44da-9e2f-f864d52de778, infoPort=45255, infoSecurePort=0, ipcPort=35919, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9bb5502a1c009b3: Processing first storage report for DS-f2b54227-edb5-4c90-80e5-3a6ec52f396d from datanode c3029a52-7b03-4f0f-a252-206a22a5741f 2023-07-20 23:10:18,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9bb5502a1c009b3: from storage DS-f2b54227-edb5-4c90-80e5-3a6ec52f396d node DatanodeRegistration(127.0.0.1:35613, datanodeUuid=c3029a52-7b03-4f0f-a252-206a22a5741f, infoPort=35083, infoSecurePort=0, ipcPort=34923, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8af38ed5d5e90cf2: Processing first storage report for DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00 from datanode 48de7011-776e-48a6-9217-4cdc988acafe 2023-07-20 23:10:18,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8af38ed5d5e90cf2: from storage DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00 node DatanodeRegistration(127.0.0.1:37953, datanodeUuid=48de7011-776e-48a6-9217-4cdc988acafe, infoPort=41993, infoSecurePort=0, ipcPort=40933, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8af38ed5d5e90cf2: Processing first storage report for DS-b280cd45-210a-4cb7-bcef-0718cd32e3b1 from datanode 48de7011-776e-48a6-9217-4cdc988acafe 2023-07-20 23:10:18,405 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8af38ed5d5e90cf2: from storage DS-b280cd45-210a-4cb7-bcef-0718cd32e3b1 node DatanodeRegistration(127.0.0.1:37953, datanodeUuid=48de7011-776e-48a6-9217-4cdc988acafe, infoPort=41993, infoSecurePort=0, ipcPort=40933, storageInfo=lv=-57;cid=testClusterID;nsid=704511107;c=1689894615440), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 23:10:18,596 DEBUG [Listener at localhost/40933] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee 2023-07-20 23:10:18,709 INFO [Listener at localhost/40933] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/zookeeper_0, clientPort=62235, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 23:10:18,729 INFO [Listener at localhost/40933] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62235 2023-07-20 23:10:18,742 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:18,745 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:19,448 INFO [Listener at localhost/40933] util.FSUtils(471): Created version file at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 with version=8 2023-07-20 23:10:19,448 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/hbase-staging 2023-07-20 23:10:19,825 INFO [Listener at localhost/40933] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 23:10:20,462 INFO [Listener at localhost/40933] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:20,513 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,514 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,514 INFO [Listener at localhost/40933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:20,515 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:20,515 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:20,735 INFO [Listener at localhost/40933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:20,844 DEBUG [Listener at localhost/40933] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 23:10:20,999 INFO [Listener at localhost/40933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42665 2023-07-20 23:10:21,013 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,016 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,048 INFO [Listener at localhost/40933] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42665 connecting to ZooKeeper ensemble=127.0.0.1:62235 2023-07-20 23:10:21,154 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:426650x0, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42665-0x101850009410000 connected 2023-07-20 23:10:21,234 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,236 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,258 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,271 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42665 2023-07-20 23:10:21,273 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42665 2023-07-20 23:10:21,273 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42665 2023-07-20 23:10:21,274 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42665 2023-07-20 23:10:21,277 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42665 2023-07-20 23:10:21,283 INFO [Listener at localhost/40933] master.HMaster(444): hbase.rootdir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, hbase.cluster.distributed=false 2023-07-20 23:10:21,381 INFO [Listener at localhost/40933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,382 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,382 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,382 INFO [Listener at localhost/40933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,382 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,382 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,389 INFO [Listener at localhost/40933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,394 INFO [Listener at localhost/40933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33297 2023-07-20 23:10:21,397 INFO [Listener at localhost/40933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,408 INFO [Listener at localhost/40933] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 23:10:21,409 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,412 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,415 INFO [Listener at localhost/40933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33297 connecting to ZooKeeper ensemble=127.0.0.1:62235 2023-07-20 23:10:21,428 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:332970x0, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33297-0x101850009410001 connected 2023-07-20 23:10:21,430 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,432 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,433 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,434 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-20 23:10:21,438 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33297 2023-07-20 23:10:21,443 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33297 2023-07-20 23:10:21,445 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-20 23:10:21,446 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33297 2023-07-20 23:10:21,466 INFO [Listener at localhost/40933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,466 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,467 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,468 INFO [Listener at localhost/40933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,468 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,468 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,468 INFO [Listener at localhost/40933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,472 INFO [Listener at localhost/40933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35883 2023-07-20 23:10:21,473 INFO [Listener at localhost/40933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,475 INFO [Listener at localhost/40933] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 23:10:21,476 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,480 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,486 INFO [Listener at localhost/40933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35883 connecting to ZooKeeper ensemble=127.0.0.1:62235 2023-07-20 23:10:21,500 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:358830x0, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,507 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:358830x0, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,508 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:358830x0, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,509 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:358830x0, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35883-0x101850009410002 connected 2023-07-20 23:10:21,518 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35883 2023-07-20 23:10:21,519 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35883 2023-07-20 23:10:21,522 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35883 2023-07-20 23:10:21,526 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35883 2023-07-20 23:10:21,528 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35883 2023-07-20 23:10:21,546 INFO [Listener at localhost/40933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 23:10:21,547 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,547 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,547 INFO [Listener at localhost/40933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 23:10:21,547 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 23:10:21,547 INFO [Listener at localhost/40933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 23:10:21,548 INFO [Listener at localhost/40933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 23:10:21,550 INFO [Listener at localhost/40933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44911 2023-07-20 23:10:21,550 INFO [Listener at localhost/40933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 23:10:21,555 INFO [Listener at localhost/40933] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 23:10:21,556 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,559 INFO [Listener at localhost/40933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,561 INFO [Listener at localhost/40933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44911 connecting to ZooKeeper ensemble=127.0.0.1:62235 2023-07-20 23:10:21,570 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:449110x0, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 23:10:21,572 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:449110x0, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:10:21,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44911-0x101850009410003 connected 2023-07-20 23:10:21,573 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:10:21,574 DEBUG [Listener at localhost/40933] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 23:10:21,574 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44911 2023-07-20 23:10:21,575 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44911 2023-07-20 23:10:21,583 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44911 2023-07-20 23:10:21,587 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44911 2023-07-20 23:10:21,587 DEBUG [Listener at localhost/40933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44911 2023-07-20 23:10:21,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:21,603 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 23:10:21,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:21,637 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,638 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,638 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,637 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 23:10:21,638 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:21,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 23:10:21,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42665,1689894619633 from backup master directory 2023-07-20 23:10:21,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 23:10:21,648 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:21,648 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 23:10:21,649 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:21,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 23:10:21,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 23:10:21,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/hbase.id with ID: 5c3cc434-49ae-4735-8e61-b0f8578b02f8 2023-07-20 23:10:21,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 23:10:21,874 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:21,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4da945dc to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:21,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b9a929, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:22,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 23:10:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 23:10:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 23:10:22,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:22,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store-tmp 2023-07-20 23:10:22,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:22,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 23:10:22,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 23:10:22,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:10:22,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:10:22,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/WALs/jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:22,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42665%2C1689894619633, suffix=, logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/WALs/jenkins-hbase4.apache.org,42665,1689894619633, archiveDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/oldWALs, maxLogs=10 2023-07-20 23:10:22,258 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK] 2023-07-20 23:10:22,260 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK] 2023-07-20 23:10:22,260 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK] 2023-07-20 23:10:22,271 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 23:10:22,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/WALs/jenkins-hbase4.apache.org,42665,1689894619633/jenkins-hbase4.apache.org%2C42665%2C1689894619633.1689894622188 2023-07-20 23:10:22,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK], DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK], DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK]] 2023-07-20 23:10:22,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:22,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:22,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,456 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,464 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 23:10:22,499 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 23:10:22,513 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:22,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 23:10:22,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:22,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71007069, jitterRate=0.0580877810716629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:22,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:10:22,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 23:10:22,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 23:10:22,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 23:10:22,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 23:10:22,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 23:10:22,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 49 msec 2023-07-20 23:10:22,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 23:10:22,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 23:10:22,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 23:10:22,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 23:10:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 23:10:22,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 23:10:22,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 23:10:22,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 23:10:22,718 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 23:10:22,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 23:10:22,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 23:10:22,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 23:10:22,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42665,1689894619633, sessionid=0x101850009410000, setting cluster-up flag (Was=false) 2023-07-20 23:10:22,765 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 23:10:22,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:22,781 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:22,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 23:10:22,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:22,806 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp 2023-07-20 23:10:22,894 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(951): ClusterId : 5c3cc434-49ae-4735-8e61-b0f8578b02f8 2023-07-20 23:10:22,895 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(951): ClusterId : 5c3cc434-49ae-4735-8e61-b0f8578b02f8 2023-07-20 23:10:22,905 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(951): ClusterId : 5c3cc434-49ae-4735-8e61-b0f8578b02f8 2023-07-20 23:10:22,912 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,914 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,913 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 23:10:22,927 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,928 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 23:10:22,928 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 23:10:22,928 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,928 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,929 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 23:10:22,936 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,936 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,938 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 23:10:22,947 DEBUG [RS:1;jenkins-hbase4:35883] zookeeper.ReadOnlyZKClient(139): Connect 0x79fb140c to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,948 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ReadOnlyZKClient(139): Connect 0x05fe5da4 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:22,952 DEBUG [RS:2;jenkins-hbase4:44911] zookeeper.ReadOnlyZKClient(139): Connect 0x3ec7e634 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:22,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 23:10:22,983 DEBUG [RS:1;jenkins-hbase4:35883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32d1dc81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:22,984 DEBUG [RS:1;jenkins-hbase4:35883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5094a03c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:23,010 DEBUG [RS:2;jenkins-hbase4:44911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37987842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:23,010 DEBUG [RS:0;jenkins-hbase4:33297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@668e2409, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:23,011 DEBUG [RS:2;jenkins-hbase4:44911] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46e11d1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:23,012 DEBUG [RS:0;jenkins-hbase4:33297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7807106e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:10:23,031 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35883 2023-07-20 23:10:23,031 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33297 2023-07-20 23:10:23,037 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44911 2023-07-20 23:10:23,039 INFO [RS:1;jenkins-hbase4:35883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,039 INFO [RS:2;jenkins-hbase4:44911] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,041 INFO [RS:0;jenkins-hbase4:33297] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 23:10:23,042 INFO [RS:0;jenkins-hbase4:33297] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,042 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,042 INFO [RS:2;jenkins-hbase4:44911] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,041 INFO [RS:1;jenkins-hbase4:35883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 23:10:23,044 INFO [RS:0;jenkins-hbase4:33297] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,045 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,044 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 23:10:23,045 INFO [RS:1;jenkins-hbase4:35883] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,045 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,045 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,045 INFO [RS:2;jenkins-hbase4:44911] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:23,046 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 23:10:23,049 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42665,1689894619633 with isa=jenkins-hbase4.apache.org/172.31.14.131:44911, startcode=1689894621546 2023-07-20 23:10:23,049 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42665,1689894619633 with isa=jenkins-hbase4.apache.org/172.31.14.131:35883, startcode=1689894621465 2023-07-20 23:10:23,049 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42665,1689894619633 with isa=jenkins-hbase4.apache.org/172.31.14.131:33297, startcode=1689894621380 2023-07-20 23:10:23,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,076 DEBUG [RS:0;jenkins-hbase4:33297] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,075 DEBUG [RS:2;jenkins-hbase4:44911] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,075 DEBUG [RS:1;jenkins-hbase4:35883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 23:10:23,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 23:10:23,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 23:10:23,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689894653104 2023-07-20 23:10:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 23:10:23,126 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,127 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 23:10:23,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 23:10:23,134 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:23,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 23:10:23,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 23:10:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 23:10:23,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 23:10:23,148 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34583, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,148 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40871, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,148 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38789, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 23:10:23,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 23:10:23,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 23:10:23,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 23:10:23,164 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42665] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 23:10:23,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 23:10:23,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 23:10:23,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623173,5,FailOnTimeoutGroup] 2023-07-20 23:10:23,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623174,5,FailOnTimeoutGroup] 2023-07-20 23:10:23,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 23:10:23,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,196 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,210 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,218 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:23,218 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:23,218 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33859 2023-07-20 23:10:23,218 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,218 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33859 2023-07-20 23:10:23,219 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,221 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 23:10:23,222 WARN [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 23:10:23,229 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:10:23,234 DEBUG [RS:2;jenkins-hbase4:44911] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,234 WARN [RS:2;jenkins-hbase4:44911] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,236 DEBUG [RS:1;jenkins-hbase4:35883] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,235 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44911,1689894621546] 2023-07-20 23:10:23,237 WARN [RS:1;jenkins-hbase4:35883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,236 INFO [RS:2;jenkins-hbase4:44911] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,238 INFO [RS:1;jenkins-hbase4:35883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,238 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35883,1689894621465] 2023-07-20 23:10:23,238 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,238 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,250 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:23,252 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:23,253 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:23,263 DEBUG [RS:2;jenkins-hbase4:44911] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,264 DEBUG [RS:2;jenkins-hbase4:44911] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,270 DEBUG [RS:1;jenkins-hbase4:35883] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,272 DEBUG [RS:1;jenkins-hbase4:35883] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,286 DEBUG [RS:2;jenkins-hbase4:44911] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,286 DEBUG [RS:1;jenkins-hbase4:35883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,313 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:23,313 INFO [RS:1;jenkins-hbase4:35883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,325 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42665,1689894619633 with isa=jenkins-hbase4.apache.org/172.31.14.131:33297, startcode=1689894621380 2023-07-20 23:10:23,315 INFO [RS:2;jenkins-hbase4:44911] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 23:10:23,327 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,332 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:23,332 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33859 2023-07-20 23:10:23,332 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 23:10:23,335 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:10:23,335 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:10:23,335 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:10:23,336 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33297,1689894621380] 2023-07-20 23:10:23,336 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,336 WARN [RS:0;jenkins-hbase4:33297] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 23:10:23,336 INFO [RS:0;jenkins-hbase4:33297] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:23,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,336 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,337 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/info 2023-07-20 23:10:23,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,349 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 23:10:23,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 23:10:23,356 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,365 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,365 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ZKUtil(162): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:23,373 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 23:10:23,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 23:10:23,368 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 23:10:23,379 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/table 2023-07-20 23:10:23,380 INFO [RS:0;jenkins-hbase4:33297] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 23:10:23,380 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 23:10:23,384 INFO [RS:1;jenkins-hbase4:35883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,384 INFO [RS:2;jenkins-hbase4:44911] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:23,388 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740 2023-07-20 23:10:23,389 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740 2023-07-20 23:10:23,393 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 23:10:23,399 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 23:10:23,403 INFO [RS:0;jenkins-hbase4:33297] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 23:10:23,418 INFO [RS:1;jenkins-hbase4:35883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,418 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,418 INFO [RS:2;jenkins-hbase4:44911] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,427 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:23,426 INFO [RS:0;jenkins-hbase4:33297] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 23:10:23,427 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,427 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,427 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,430 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,430 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67872557, jitterRate=0.011379912495613098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 23:10:23,432 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 23:10:23,432 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 23:10:23,432 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 23:10:23,432 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 23:10:23,432 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 23:10:23,432 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 23:10:23,433 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 23:10:23,434 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 23:10:23,434 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 23:10:23,442 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 23:10:23,442 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 23:10:23,445 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,445 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,445 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,445 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,445 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,447 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,447 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,447 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,448 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,445 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,448 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:1;jenkins-hbase4:35883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,449 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,450 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,450 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,450 DEBUG [RS:0;jenkins-hbase4:33297] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 23:10:23,474 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,475 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,475 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,489 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,489 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,489 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,499 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 23:10:23,508 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 23:10:23,512 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,513 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,513 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,513 DEBUG [RS:2;jenkins-hbase4:44911] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 23:10:23,514 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 23:10:23,534 INFO [RS:0;jenkins-hbase4:33297] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,535 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,535 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,535 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,540 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33297,1689894621380-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,534 INFO [RS:1;jenkins-hbase4:35883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,543 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35883,1689894621465-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,561 INFO [RS:2;jenkins-hbase4:44911] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 23:10:23,561 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44911,1689894621546-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:23,576 INFO [RS:0;jenkins-hbase4:33297] regionserver.Replication(203): jenkins-hbase4.apache.org,33297,1689894621380 started 2023-07-20 23:10:23,576 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33297,1689894621380, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33297, sessionid=0x101850009410001 2023-07-20 23:10:23,577 INFO [RS:1;jenkins-hbase4:35883] regionserver.Replication(203): jenkins-hbase4.apache.org,35883,1689894621465 started 2023-07-20 23:10:23,577 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35883,1689894621465, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35883, sessionid=0x101850009410002 2023-07-20 23:10:23,577 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,577 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,577 DEBUG [RS:0;jenkins-hbase4:33297] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,577 DEBUG [RS:1;jenkins-hbase4:35883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,578 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33297,1689894621380' 2023-07-20 23:10:23,579 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,578 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35883,1689894621465' 2023-07-20 23:10:23,579 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,580 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,581 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,581 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,581 DEBUG [RS:0;jenkins-hbase4:33297] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:23,581 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33297,1689894621380' 2023-07-20 23:10:23,581 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,582 DEBUG [RS:0;jenkins-hbase4:33297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,582 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,584 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,584 DEBUG [RS:0;jenkins-hbase4:33297] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,584 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,584 INFO [RS:0;jenkins-hbase4:33297] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,584 INFO [RS:0;jenkins-hbase4:33297] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,584 DEBUG [RS:1;jenkins-hbase4:35883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:23,587 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35883,1689894621465' 2023-07-20 23:10:23,587 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,588 DEBUG [RS:1;jenkins-hbase4:35883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,588 INFO [RS:2;jenkins-hbase4:44911] regionserver.Replication(203): jenkins-hbase4.apache.org,44911,1689894621546 started 2023-07-20 23:10:23,588 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44911,1689894621546, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44911, sessionid=0x101850009410003 2023-07-20 23:10:23,589 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 23:10:23,589 DEBUG [RS:2;jenkins-hbase4:44911] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,589 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44911,1689894621546' 2023-07-20 23:10:23,589 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 23:10:23,590 DEBUG [RS:1;jenkins-hbase4:35883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,590 INFO [RS:1;jenkins-hbase4:35883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,591 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 23:10:23,591 INFO [RS:1;jenkins-hbase4:35883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44911,1689894621546' 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:23,592 DEBUG [RS:2;jenkins-hbase4:44911] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:23,593 DEBUG [RS:2;jenkins-hbase4:44911] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 23:10:23,593 INFO [RS:2;jenkins-hbase4:44911] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 23:10:23,593 INFO [RS:2;jenkins-hbase4:44911] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 23:10:23,698 INFO [RS:2;jenkins-hbase4:44911] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44911%2C1689894621546, suffix=, logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,44911,1689894621546, archiveDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs, maxLogs=32 2023-07-20 23:10:23,698 INFO [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33297%2C1689894621380, suffix=, logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,33297,1689894621380, archiveDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs, maxLogs=32 2023-07-20 23:10:23,705 INFO [RS:1;jenkins-hbase4:35883] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35883%2C1689894621465, suffix=, logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,35883,1689894621465, archiveDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs, maxLogs=32 2023-07-20 23:10:23,708 DEBUG [jenkins-hbase4:42665] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 23:10:23,713 DEBUG [jenkins-hbase4:42665] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:23,721 DEBUG [jenkins-hbase4:42665] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:23,721 DEBUG [jenkins-hbase4:42665] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:23,721 DEBUG [jenkins-hbase4:42665] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:23,721 DEBUG [jenkins-hbase4:42665] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:23,748 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33297,1689894621380, state=OPENING 2023-07-20 23:10:23,768 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK] 2023-07-20 23:10:23,768 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK] 2023-07-20 23:10:23,768 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK] 2023-07-20 23:10:23,776 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 23:10:23,778 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:23,779 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 23:10:23,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:10:23,820 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK] 2023-07-20 23:10:23,820 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK] 2023-07-20 23:10:23,820 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK] 2023-07-20 23:10:23,824 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK] 2023-07-20 23:10:23,825 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK] 2023-07-20 23:10:23,825 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK] 2023-07-20 23:10:23,828 INFO [RS:1;jenkins-hbase4:35883] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,35883,1689894621465/jenkins-hbase4.apache.org%2C35883%2C1689894621465.1689894623707 2023-07-20 23:10:23,830 DEBUG [RS:1;jenkins-hbase4:35883] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK], DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK], DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK]] 2023-07-20 23:10:23,843 INFO [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,33297,1689894621380/jenkins-hbase4.apache.org%2C33297%2C1689894621380.1689894623705 2023-07-20 23:10:23,843 INFO [RS:2;jenkins-hbase4:44911] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,44911,1689894621546/jenkins-hbase4.apache.org%2C44911%2C1689894621546.1689894623705 2023-07-20 23:10:23,850 DEBUG [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK], DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK]] 2023-07-20 23:10:23,851 DEBUG [RS:2;jenkins-hbase4:44911] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK], DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK]] 2023-07-20 23:10:24,013 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:24,016 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:24,020 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:24,040 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 23:10:24,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 23:10:24,046 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33297%2C1689894621380.meta, suffix=.meta, logDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,33297,1689894621380, archiveDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs, maxLogs=32 2023-07-20 23:10:24,104 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK] 2023-07-20 23:10:24,104 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK] 2023-07-20 23:10:24,106 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK] 2023-07-20 23:10:24,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/WALs/jenkins-hbase4.apache.org,33297,1689894621380/jenkins-hbase4.apache.org%2C33297%2C1689894621380.meta.1689894624047.meta 2023-07-20 23:10:24,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44315,DS-23a05071-cb2d-4dc1-bc12-ea6014e2aa7d,DISK], DatanodeInfoWithStorage[127.0.0.1:35613,DS-a345d78c-f445-45b5-a17c-7c30abb04205,DISK], DatanodeInfoWithStorage[127.0.0.1:37953,DS-c9b990b5-5f3c-4bb1-95c1-9bc4f34c9f00,DISK]] 2023-07-20 23:10:24,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:24,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 23:10:24,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:24,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 23:10:24,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 23:10:24,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 23:10:24,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 23:10:24,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:24,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 23:10:24,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 23:10:24,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 23:10:24,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/info 2023-07-20 23:10:24,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/info 2023-07-20 23:10:24,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 23:10:24,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,182 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 23:10:24,185 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:24,185 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/rep_barrier 2023-07-20 23:10:24,185 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 23:10:24,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 23:10:24,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/table 2023-07-20 23:10:24,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/table 2023-07-20 23:10:24,193 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 23:10:24,194 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:24,197 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740 2023-07-20 23:10:24,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740 2023-07-20 23:10:24,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 23:10:24,208 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 23:10:24,212 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74719273, jitterRate=0.11340393126010895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 23:10:24,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 23:10:24,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689894624005 2023-07-20 23:10:24,256 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33297,1689894621380, state=OPEN 2023-07-20 23:10:24,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 23:10:24,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 23:10:24,261 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 23:10:24,261 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 23:10:24,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 23:10:24,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33297,1689894621380 in 478 msec 2023-07-20 23:10:24,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 23:10:24,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 814 msec 2023-07-20 23:10:24,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3410 sec 2023-07-20 23:10:24,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689894624306, completionTime=-1 2023-07-20 23:10:24,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 23:10:24,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 23:10:24,391 DEBUG [hconnection-0x2920c70d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:24,395 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:24,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 23:10:24,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689894684428 2023-07-20 23:10:24,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689894744428 2023-07-20 23:10:24,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 121 msec 2023-07-20 23:10:24,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42665,1689894619633-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42665,1689894619633-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42665,1689894619633-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42665, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 23:10:24,473 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 23:10:24,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 23:10:24,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:24,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 23:10:24,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:24,516 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:24,545 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:24,548 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f empty. 2023-07-20 23:10:24,549 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:24,549 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 23:10:24,600 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:24,603 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa015f061d3a740005ba418c42ee773f, NAME => 'hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:24,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:24,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing aa015f061d3a740005ba418c42ee773f, disabling compactions & flushes 2023-07-20 23:10:24,633 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:24,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:24,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. after waiting 0 ms 2023-07-20 23:10:24,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:24,633 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:24,633 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for aa015f061d3a740005ba418c42ee773f: 2023-07-20 23:10:24,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:24,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894624643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894624643"}]},"ts":"1689894624643"} 2023-07-20 23:10:24,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 23:10:24,705 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:24,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894624705"}]},"ts":"1689894624705"} 2023-07-20 23:10:24,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 23:10:24,724 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:24,725 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:24,725 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:24,725 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:24,726 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:24,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aa015f061d3a740005ba418c42ee773f, ASSIGN}] 2023-07-20 23:10:24,739 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aa015f061d3a740005ba418c42ee773f, ASSIGN 2023-07-20 23:10:24,743 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=aa015f061d3a740005ba418c42ee773f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:10:24,896 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:10:24,897 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aa015f061d3a740005ba418c42ee773f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:24,897 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894624896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894624896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894624896"}]},"ts":"1689894624896"} 2023-07-20 23:10:24,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure aa015f061d3a740005ba418c42ee773f, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:10:25,062 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:25,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa015f061d3a740005ba418c42ee773f, NAME => 'hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:25,063 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. service=AccessControlService 2023-07-20 23:10:25,064 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:25,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,067 INFO [StoreOpener-aa015f061d3a740005ba418c42ee773f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,070 DEBUG [StoreOpener-aa015f061d3a740005ba418c42ee773f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/info 2023-07-20 23:10:25,070 DEBUG [StoreOpener-aa015f061d3a740005ba418c42ee773f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/info 2023-07-20 23:10:25,070 INFO [StoreOpener-aa015f061d3a740005ba418c42ee773f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa015f061d3a740005ba418c42ee773f columnFamilyName info 2023-07-20 23:10:25,071 INFO [StoreOpener-aa015f061d3a740005ba418c42ee773f-1] regionserver.HStore(310): Store=aa015f061d3a740005ba418c42ee773f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:25,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aa015f061d3a740005ba418c42ee773f 2023-07-20 23:10:25,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:25,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aa015f061d3a740005ba418c42ee773f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69278349, jitterRate=0.03232784569263458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:25,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aa015f061d3a740005ba418c42ee773f: 2023-07-20 23:10:25,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f., pid=6, masterSystemTime=1689894625055 2023-07-20 23:10:25,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:25,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:10:25,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aa015f061d3a740005ba418c42ee773f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:25,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689894625091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894625091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894625091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894625091"}]},"ts":"1689894625091"} 2023-07-20 23:10:25,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 23:10:25,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure aa015f061d3a740005ba418c42ee773f, server=jenkins-hbase4.apache.org,33297,1689894621380 in 194 msec 2023-07-20 23:10:25,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 23:10:25,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=aa015f061d3a740005ba418c42ee773f, ASSIGN in 370 msec 2023-07-20 23:10:25,105 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:25,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625105"}]},"ts":"1689894625105"} 2023-07-20 23:10:25,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 23:10:25,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 23:10:25,114 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:25,115 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,115 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:25,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 625 msec 2023-07-20 23:10:25,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 23:10:25,193 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 55 msec 2023-07-20 23:10:25,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 23:10:25,224 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 23:10:25,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-20 23:10:25,239 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 23:10:25,242 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 23:10:25,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.594sec 2023-07-20 23:10:25,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 23:10:25,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 23:10:25,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 23:10:25,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42665,1689894619633-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 23:10:25,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42665,1689894619633-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 23:10:25,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 23:10:25,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 23:10:25,281 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:25,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:25,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 23:10:25,295 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,296 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b empty. 2023-07-20 23:10:25,300 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,302 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 23:10:25,314 DEBUG [Listener at localhost/40933] zookeeper.ReadOnlyZKClient(139): Connect 0x37ed2880 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:25,332 DEBUG [Listener at localhost/40933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416d673c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:25,349 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:25,351 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 64a30d165b3faa5d7b67f444c416918b, NAME => 'hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:25,363 DEBUG [hconnection-0x2a6c5873-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:25,384 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 64a30d165b3faa5d7b67f444c416918b, disabling compactions & flushes 2023-07-20 23:10:25,385 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. after waiting 0 ms 2023-07-20 23:10:25,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,385 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 64a30d165b3faa5d7b67f444c416918b: 2023-07-20 23:10:25,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:25,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/test.cache.data in system properties and HBase conf 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop.log.dir in system properties and HBase conf 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 23:10:25,392 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 23:10:25,393 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/nfs.dump.dir in system properties and HBase conf 2023-07-20 23:10:25,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894625393"}]},"ts":"1689894625393"} 2023-07-20 23:10:25,394 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir in system properties and HBase conf 2023-07-20 23:10:25,394 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 23:10:25,394 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 23:10:25,394 INFO [Listener at localhost/40933] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 23:10:25,397 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 23:10:25,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:25,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625399"}]},"ts":"1689894625399"} 2023-07-20 23:10:25,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 23:10:25,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,407 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:25,408 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:25,408 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:25,408 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:25,408 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:25,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=64a30d165b3faa5d7b67f444c416918b, ASSIGN}] 2023-07-20 23:10:25,413 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=64a30d165b3faa5d7b67f444c416918b, ASSIGN 2023-07-20 23:10:25,414 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=64a30d165b3faa5d7b67f444c416918b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:10:25,565 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:10:25,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=64a30d165b3faa5d7b67f444c416918b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:25,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894625566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894625566"}]},"ts":"1689894625566"} 2023-07-20 23:10:25,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 64a30d165b3faa5d7b67f444c416918b, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:10:25,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,738 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64a30d165b3faa5d7b67f444c416918b, NAME => 'hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. service=AccessControlService 2023-07-20 23:10:25,739 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,743 INFO [StoreOpener-64a30d165b3faa5d7b67f444c416918b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,745 DEBUG [StoreOpener-64a30d165b3faa5d7b67f444c416918b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/l 2023-07-20 23:10:25,746 DEBUG [StoreOpener-64a30d165b3faa5d7b67f444c416918b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/l 2023-07-20 23:10:25,746 INFO [StoreOpener-64a30d165b3faa5d7b67f444c416918b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64a30d165b3faa5d7b67f444c416918b columnFamilyName l 2023-07-20 23:10:25,747 INFO [StoreOpener-64a30d165b3faa5d7b67f444c416918b-1] regionserver.HStore(310): Store=64a30d165b3faa5d7b67f444c416918b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:25,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,761 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:10:25,768 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:25,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 64a30d165b3faa5d7b67f444c416918b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65259326, jitterRate=-0.027560263872146606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:25,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 64a30d165b3faa5d7b67f444c416918b: 2023-07-20 23:10:25,772 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b., pid=11, masterSystemTime=1689894625724 2023-07-20 23:10:25,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,785 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:10:25,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=64a30d165b3faa5d7b67f444c416918b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:25,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689894625786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894625786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894625786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894625786"}]},"ts":"1689894625786"} 2023-07-20 23:10:25,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 23:10:25,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 64a30d165b3faa5d7b67f444c416918b, server=jenkins-hbase4.apache.org,33297,1689894621380 in 221 msec 2023-07-20 23:10:25,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 23:10:25,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=64a30d165b3faa5d7b67f444c416918b, ASSIGN in 389 msec 2023-07-20 23:10:25,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:25,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894625807"}]},"ts":"1689894625807"} 2023-07-20 23:10:25,810 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 23:10:25,814 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:25,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 537 msec 2023-07-20 23:10:25,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 23:10:25,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 23:10:25,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 23:10:26,801 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:27,092 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:27,099 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33479_jobhistory____.belz1d/webapp 2023-07-20 23:10:27,256 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 23:10:27,256 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:27,256 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:27,260 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:27,347 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:27,637 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:28,022 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 23:10:28,091 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33479 2023-07-20 23:10:28,287 WARN [Listener at jenkins-hbase4.apache.org/36379] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:28,709 WARN [Listener at jenkins-hbase4.apache.org/36379] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:28,710 INFO [Listener at jenkins-hbase4.apache.org/36379] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:28,723 INFO [Listener at jenkins-hbase4.apache.org/36379] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45531_cluster____.xr57f2/webapp 2023-07-20 23:10:28,793 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:28,793 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 23:10:28,793 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:28,794 INFO [Listener at jenkins-hbase4.apache.org/36379] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:28,803 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,026 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,303 INFO [Listener at jenkins-hbase4.apache.org/36379] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:29,359 INFO [Listener at jenkins-hbase4.apache.org/36379] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45531 2023-07-20 23:10:29,893 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:10:29,941 WARN [Listener at jenkins-hbase4.apache.org/36083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:29,970 WARN [Listener at jenkins-hbase4.apache.org/36083] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:29,970 INFO [Listener at jenkins-hbase4.apache.org/36083] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:29,991 INFO [Listener at jenkins-hbase4.apache.org/36083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35561_node____6g8wng/webapp 2023-07-20 23:10:30,072 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 23:10:30,072 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:30,072 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:30,073 INFO [Listener at jenkins-hbase4.apache.org/36083] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:30,093 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 23:10:30,095 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 23:10:30,096 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 23:10:30,097 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,098 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,098 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 23:10:30,115 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,115 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 23:10:30,115 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 23:10:30,115 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 23:10:30,115 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:30,115 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 23:10:30,116 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 23:10:30,116 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 23:10:30,125 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,243 INFO [Listener at jenkins-hbase4.apache.org/36083] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,259 INFO [Listener at jenkins-hbase4.apache.org/36083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35561 2023-07-20 23:10:30,526 WARN [Listener at jenkins-hbase4.apache.org/45891] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 23:10:30,535 WARN [Listener at jenkins-hbase4.apache.org/45891] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 23:10:30,536 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 23:10:30,545 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38859_node____.s27q0b/webapp 2023-07-20 23:10:30,605 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 23:10:30,605 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 23:10:30,605 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 23:10:30,605 INFO [Listener at jenkins-hbase4.apache.org/45891] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 23:10:30,615 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,632 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,722 INFO [Listener at jenkins-hbase4.apache.org/45891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 23:10:30,734 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38859 2023-07-20 23:10:30,776 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 23:10:30,778 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:30,872 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=173, AvailableMemoryMB=3068 2023-07-20 23:10:30,872 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-20 23:10:30,887 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 23:10:30,896 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 23:10:30,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:10:30,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:30,924 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:30,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 23:10:30,928 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:30,934 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:30,934 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:30,936 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d empty. 2023-07-20 23:10:30,936 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db empty. 2023-07-20 23:10:30,938 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:30,938 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:30,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 23:10:30,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:30,978 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:30,980 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => bcbcaa7f3a415378afac668d1251f5db, NAME => 'testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:30,980 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7ed9474d7cf05534a8fd87b726ab846d, NAME => 'testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:31,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 7ed9474d7cf05534a8fd87b726ab846d, disabling compactions & flushes 2023-07-20 23:10:31,033 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. after waiting 0 ms 2023-07-20 23:10:31,033 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,034 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,034 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 7ed9474d7cf05534a8fd87b726ab846d: 2023-07-20 23:10:31,037 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,038 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing bcbcaa7f3a415378afac668d1251f5db, disabling compactions & flushes 2023-07-20 23:10:31,038 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,038 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,038 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. after waiting 0 ms 2023-07-20 23:10:31,038 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,038 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,038 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for bcbcaa7f3a415378afac668d1251f5db: 2023-07-20 23:10:31,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,043 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:31,045 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894631045"}]},"ts":"1689894631045"} 2023-07-20 23:10:31,045 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894631045"}]},"ts":"1689894631045"} 2023-07-20 23:10:31,102 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:10:31,105 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:31,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894631105"}]},"ts":"1689894631105"} 2023-07-20 23:10:31,108 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 23:10:31,115 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:31,118 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:31,118 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:31,118 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:31,118 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:31,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, ASSIGN}] 2023-07-20 23:10:31,123 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, ASSIGN 2023-07-20 23:10:31,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, ASSIGN 2023-07-20 23:10:31,125 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:10:31,125 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:10:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,275 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:10:31,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bcbcaa7f3a415378afac668d1251f5db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:31,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7ed9474d7cf05534a8fd87b726ab846d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:31,278 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894631278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894631278"}]},"ts":"1689894631278"} 2023-07-20 23:10:31,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894631278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894631278"}]},"ts":"1689894631278"} 2023-07-20 23:10:31,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure bcbcaa7f3a415378afac668d1251f5db, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:10:31,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 7ed9474d7cf05534a8fd87b726ab846d, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:10:31,435 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:31,435 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:31,439 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:31,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ed9474d7cf05534a8fd87b726ab846d, NAME => 'testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. service=AccessControlService 2023-07-20 23:10:31,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:31,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcbcaa7f3a415378afac668d1251f5db, NAME => 'testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. service=AccessControlService 2023-07-20 23:10:31,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,448 INFO [StoreOpener-7ed9474d7cf05534a8fd87b726ab846d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,448 INFO [StoreOpener-bcbcaa7f3a415378afac668d1251f5db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,450 DEBUG [StoreOpener-7ed9474d7cf05534a8fd87b726ab846d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf 2023-07-20 23:10:31,450 DEBUG [StoreOpener-7ed9474d7cf05534a8fd87b726ab846d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf 2023-07-20 23:10:31,450 DEBUG [StoreOpener-bcbcaa7f3a415378afac668d1251f5db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf 2023-07-20 23:10:31,450 DEBUG [StoreOpener-bcbcaa7f3a415378afac668d1251f5db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf 2023-07-20 23:10:31,454 INFO [StoreOpener-bcbcaa7f3a415378afac668d1251f5db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcbcaa7f3a415378afac668d1251f5db columnFamilyName cf 2023-07-20 23:10:31,454 INFO [StoreOpener-7ed9474d7cf05534a8fd87b726ab846d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ed9474d7cf05534a8fd87b726ab846d columnFamilyName cf 2023-07-20 23:10:31,457 INFO [StoreOpener-7ed9474d7cf05534a8fd87b726ab846d-1] regionserver.HStore(310): Store=7ed9474d7cf05534a8fd87b726ab846d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:31,457 INFO [StoreOpener-bcbcaa7f3a415378afac668d1251f5db-1] regionserver.HStore(310): Store=bcbcaa7f3a415378afac668d1251f5db/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:31,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:31,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:31,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:31,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:31,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bcbcaa7f3a415378afac668d1251f5db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68828014, jitterRate=0.025617331266403198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:31,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bcbcaa7f3a415378afac668d1251f5db: 2023-07-20 23:10:31,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ed9474d7cf05534a8fd87b726ab846d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59028056, jitterRate=-0.12041342258453369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:31,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ed9474d7cf05534a8fd87b726ab846d: 2023-07-20 23:10:31,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db., pid=15, masterSystemTime=1689894631435 2023-07-20 23:10:31,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d., pid=16, masterSystemTime=1689894631435 2023-07-20 23:10:31,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:31,479 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=bcbcaa7f3a415378afac668d1251f5db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:31,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:31,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894631479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894631479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894631479"}]},"ts":"1689894631479"} 2023-07-20 23:10:31,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7ed9474d7cf05534a8fd87b726ab846d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:31,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894631480"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894631480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894631480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894631480"}]},"ts":"1689894631480"} 2023-07-20 23:10:31,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-20 23:10:31,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure bcbcaa7f3a415378afac668d1251f5db, server=jenkins-hbase4.apache.org,35883,1689894621465 in 201 msec 2023-07-20 23:10:31,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-20 23:10:31,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 7ed9474d7cf05534a8fd87b726ab846d, server=jenkins-hbase4.apache.org,33297,1689894621380 in 202 msec 2023-07-20 23:10:31,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, ASSIGN in 368 msec 2023-07-20 23:10:31,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-20 23:10:31,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, ASSIGN in 373 msec 2023-07-20 23:10:31,500 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:31,500 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894631500"}]},"ts":"1689894631500"} 2023-07-20 23:10:31,502 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 23:10:31,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:31,515 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 23:10:31,540 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:31,584 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,584 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,584 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,584 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:10:31,584 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:31,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:31,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 680 msec 2023-07-20 23:10:32,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 23:10:32,049 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 23:10:32,053 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 23:10:32,055 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:32,057 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:32,084 DEBUG [hconnection-0x2a6c5873-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,091 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894632112 (current time:1689894632112). 2023-07-20 23:10:32,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:32,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x704f807a to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40307d00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,129 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x704f807a to 127.0.0.1:62235 2023-07-20 23:10:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x7911927f to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7879fde0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,142 DEBUG [hconnection-0x67bfcfc6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,146 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7911927f to 127.0.0.1:62235 2023-07-20 23:10:32,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:32,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:32,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,212 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,214 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689895232214 2023-07-20 23:10:32,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 23:10:32,232 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 33 msec 2023-07-20 23:10:32,237 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,239 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689895232239 2023-07-20 23:10:32,239 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:32,239 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:32,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,281 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 23:10:32,281 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,283 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 23:10:32,283 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 23:10:32,284 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,284 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,289 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,289 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,289 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,289 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,291 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,291 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,291 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,291 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 23:10:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,301 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,301 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,302 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,302 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,302 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,302 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,303 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,304 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,304 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,306 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,306 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,311 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f77157[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f77157[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:32,317 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 23:10:32,318 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,321 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,321 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:10:32,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,321 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,321 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,322 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,323 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:32,323 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. started... 2023-07-20 23:10:32,328 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,328 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,328 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:32,328 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. started... 2023-07-20 23:10:32,329 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,329 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,329 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ed9474d7cf05534a8fd87b726ab846d: 2023-07-20 23:10:32,332 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcbcaa7f3a415378afac668d1251f5db: 2023-07-20 23:10:32,333 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,333 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,340 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,342 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:32,342 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:32,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:32,345 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:32,347 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:32,347 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:32,400 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. completed. 2023-07-20 23:10:32,400 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:32,400 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. completed. 2023-07-20 23:10:32,400 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:10:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:10:32,403 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,403 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:10:32,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 23:10:32,418 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 23:10:32,418 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:32,418 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:32,418 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,418 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:32,422 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,422 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,423 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,423 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,423 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,424 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,425 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,428 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,428 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,429 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,449 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,450 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:32,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,451 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 23:10:32,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:10:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,451 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,452 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,452 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:32,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:10:32,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,545 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:32,548 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:32,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 23:10:32,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:32,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689894632229Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689894632475 (+246 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689894632475Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689894632476 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689894632493 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689894632526 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689894632576 (+50 ms) 2023-07-20 23:10:32,580 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 347 msec 2023-07-20 23:10:32,849 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:32,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:32,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:32,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:32,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:32,873 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 23:10:32,873 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:32,873 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:32,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894632889 (current time:1689894632889). 2023-07-20 23:10:32,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:32,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x769e0385 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@762c4859, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,900 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x769e0385 to 127.0.0.1:62235 2023-07-20 23:10:32,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x6dd02b15 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:32,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b548f01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:32,914 DEBUG [hconnection-0x7fae6cb2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:32,917 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:32,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dd02b15 to 127.0.0.1:62235 2023-07-20 23:10:32,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:32,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 23:10:32,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:32,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,928 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,930 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689895232930 2023-07-20 23:10:32,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 23:10:32,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 23:10:32,931 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:32,931 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:32,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,933 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 23:10:32,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-20 23:10:32,936 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:32,937 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689895232937 2023-07-20 23:10:32,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 23:10:32,957 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 23:10:32,957 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,958 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 23:10:32,958 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 23:10:32,958 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,958 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,960 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,960 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:32,961 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,961 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,961 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 23:10:32,962 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,962 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 23:10:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,966 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 23:10:32,966 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 23:10:32,966 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 23:10:32,968 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,969 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,970 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,971 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,971 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,971 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce49cb3[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:32,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 23:10:32,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce49cb3[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:32,978 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 23:10:32,978 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,988 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,988 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,988 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:32,989 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:32,989 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:32,989 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:32,990 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. started... 2023-07-20 23:10:32,990 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. started... 2023-07-20 23:10:32,990 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:32,990 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bcbcaa7f3a415378afac668d1251f5db 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 23:10:32,990 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ed9474d7cf05534a8fd87b726ab846d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 23:10:32,990 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:32,994 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:33,031 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:33,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:33,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:33,034 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:33,165 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76 2023-07-20 23:10:33,165 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e 2023-07-20 23:10:33,201 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/.tmp/cf/2fe955318e1f4957a4081c4a0a3b1242 2023-07-20 23:10:33,203 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/.tmp/cf/14817a366bd94f62bc947b4bacfb582f 2023-07-20 23:10:33,213 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/.tmp/cf/14817a366bd94f62bc947b4bacfb582f as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f 2023-07-20 23:10:33,213 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/.tmp/cf/2fe955318e1f4957a4081c4a0a3b1242 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242 2023-07-20 23:10:33,223 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f, entries=47, sequenceid=6, filesize=12.8 K 2023-07-20 23:10:33,224 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 23:10:33,228 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for bcbcaa7f3a415378afac668d1251f5db in 238ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:33,228 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7ed9474d7cf05534a8fd87b726ab846d in 238ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:33,228 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 23:10:33,228 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 23:10:33,230 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bcbcaa7f3a415378afac668d1251f5db: 2023-07-20 23:10:33,230 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ed9474d7cf05534a8fd87b726ab846d: 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f] hfiles 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242] hfiles 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:33,231 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:33,234 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:33,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:33,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:33,236 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:33,259 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. completed. 2023-07-20 23:10:33,259 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:10:33,261 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:10:33,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 23:10:33,536 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:33,538 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:10:33,660 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. completed. 2023-07-20 23:10:33,660 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 23:10:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:10:33,662 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 23:10:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 23:10:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:10:33,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 23:10:33,668 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 23:10:33,668 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:33,668 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:33,668 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 23:10:33,668 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,671 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:33,672 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,672 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,673 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:33,674 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:33,676 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 23:10:33,677 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,677 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,690 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:33,691 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:33,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:33,691 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:33,690 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:33,690 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:33,692 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,691 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 23:10:33,691 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 23:10:33,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:33,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 23:10:33,691 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:33,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:10:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:33,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,692 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:33,692 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,693 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:33,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76] mob files 2023-07-20 23:10:33,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e 2023-07-20 23:10:33,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76 2023-07-20 23:10:33,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 23:10:33,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 23:10:33,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,789 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 23:10:33,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689894632930Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689894633711 (+781 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689894633711Loading Region manifests for snaptb0-testExportWithTargetName at 1689894633711Writing data manifest for snaptb0-testExportWithTargetName at 1689894633719 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689894633742 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689894633788 (+46 ms) 2023-07-20 23:10:33,791 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 23:10:33,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 860 msec 2023-07-20 23:10:34,038 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:34,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 23:10:34,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:34,041 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041 2023-07-20 23:10:34,041 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33859, tgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041, rawTgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:34,081 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:34,081 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-73611928_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 23:10:34,081 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 23:10:34,102 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 23:10:34,175 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,175 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,176 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,176 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,176 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,177 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,177 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,256 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-5164496842459564371.jar 2023-07-20 23:10:34,257 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,258 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,258 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,259 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,260 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,260 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:34,261 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:10:34,262 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:10:34,262 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:10:34,263 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:10:34,264 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:10:34,264 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:10:34,265 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:10:34,266 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:10:34,266 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:10:34,267 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:10:34,271 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:34,272 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:34,272 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:34,272 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:34,273 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:34,273 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:34,274 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:35,302 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:10:35,308 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 23:10:35,319 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 23:10:35,768 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:35,770 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:36,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:36,953 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:10:41,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:44,242 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:47,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:49,303 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:10:49,305 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:10:49,315 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 23:10:49,315 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:10:49,316 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:10:49,316 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 23:10:49,317 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 23:10:49,317 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 23:10:49,317 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/testExportWithTargetName 2023-07-20 23:10:49,317 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 23:10:49,317 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894634041/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 23:10:49,327 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 23:10:49,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 23:10:49,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894649346"}]},"ts":"1689894649346"} 2023-07-20 23:10:49,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:49,348 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 23:10:49,350 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 23:10:49,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, UNASSIGN}] 2023-07-20 23:10:49,354 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, UNASSIGN 2023-07-20 23:10:49,354 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, UNASSIGN 2023-07-20 23:10:49,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=bcbcaa7f3a415378afac668d1251f5db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:49,355 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7ed9474d7cf05534a8fd87b726ab846d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:49,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894649355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894649355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894649355"}]},"ts":"1689894649355"} 2023-07-20 23:10:49,355 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894649355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894649355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894649355"}]},"ts":"1689894649355"} 2023-07-20 23:10:49,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure bcbcaa7f3a415378afac668d1251f5db, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:10:49,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 7ed9474d7cf05534a8fd87b726ab846d, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:10:49,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:49,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:49,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bcbcaa7f3a415378afac668d1251f5db, disabling compactions & flushes 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ed9474d7cf05534a8fd87b726ab846d, disabling compactions & flushes 2023-07-20 23:10:49,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:49,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. after waiting 0 ms 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. after waiting 0 ms 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:49,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:49,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:10:49,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:10:49,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:49,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:10:49,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d. 2023-07-20 23:10:49,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db. 2023-07-20 23:10:49,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ed9474d7cf05534a8fd87b726ab846d: 2023-07-20 23:10:49,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bcbcaa7f3a415378afac668d1251f5db: 2023-07-20 23:10:49,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:49,545 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7ed9474d7cf05534a8fd87b726ab846d, regionState=CLOSED 2023-07-20 23:10:49,545 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894649544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894649544"}]},"ts":"1689894649544"} 2023-07-20 23:10:49,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:49,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=bcbcaa7f3a415378afac668d1251f5db, regionState=CLOSED 2023-07-20 23:10:49,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689894649546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894649546"}]},"ts":"1689894649546"} 2023-07-20 23:10:49,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-20 23:10:49,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 7ed9474d7cf05534a8fd87b726ab846d, server=jenkins-hbase4.apache.org,33297,1689894621380 in 189 msec 2023-07-20 23:10:49,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-20 23:10:49,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure bcbcaa7f3a415378afac668d1251f5db, server=jenkins-hbase4.apache.org,35883,1689894621465 in 191 msec 2023-07-20 23:10:49,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ed9474d7cf05534a8fd87b726ab846d, UNASSIGN in 198 msec 2023-07-20 23:10:49,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-20 23:10:49,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bcbcaa7f3a415378afac668d1251f5db, UNASSIGN in 200 msec 2023-07-20 23:10:49,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894649555"}]},"ts":"1689894649555"} 2023-07-20 23:10:49,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 23:10:49,559 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 23:10:49,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-20 23:10:49,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 23:10:49,650 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 23:10:49,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 23:10:49,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,670 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 23:10:49,672 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,676 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 23:10:49,679 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:49,679 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:49,679 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:49,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:49,679 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:49,679 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 23:10:49,681 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:49,681 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:49,681 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:49,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 23:10:49,682 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:49,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 23:10:49,682 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:10:49,682 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:10:49,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 23:10:49,682 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:10:49,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 23:10:49,682 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:10:49,684 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/recovered.edits] 2023-07-20 23:10:49,684 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/recovered.edits] 2023-07-20 23:10:49,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 23:10:49,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/cf/14817a366bd94f62bc947b4bacfb582f 2023-07-20 23:10:49,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/cf/2fe955318e1f4957a4081c4a0a3b1242 2023-07-20 23:10:49,696 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d/recovered.edits/9.seqid 2023-07-20 23:10:49,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db/recovered.edits/9.seqid 2023-07-20 23:10:49,697 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/7ed9474d7cf05534a8fd87b726ab846d 2023-07-20 23:10:49,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportWithTargetName/bcbcaa7f3a415378afac668d1251f5db 2023-07-20 23:10:49,697 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 23:10:49,698 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 23:10:49,699 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-20 23:10:49,704 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720c89494838b00457cb4bb12fa6afbf58e 2023-07-20 23:10:49,705 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720a4b19de31ed947679bc7fa455dfc2b76 2023-07-20 23:10:49,706 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 23:10:49,709 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,730 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 23:10:49,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 23:10:49,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 23:10:49,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894649734"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:49,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894649734"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:49,737 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:10:49,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcbcaa7f3a415378afac668d1251f5db, NAME => 'testtb-testExportWithTargetName,,1689894630917.bcbcaa7f3a415378afac668d1251f5db.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7ed9474d7cf05534a8fd87b726ab846d, NAME => 'testtb-testExportWithTargetName,1,1689894630917.7ed9474d7cf05534a8fd87b726ab846d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:10:49,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 23:10:49,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894649737"}]},"ts":"9223372036854775807"} 2023-07-20 23:10:49,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 23:10:49,742 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 23:10:49,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-07-20 23:10:49,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 23:10:49,788 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 23:10:49,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 23:10:49,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 23:10:49,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 23:10:49,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 23:10:49,852 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 704) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-350882741_1 at /127.0.0.1:54596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:35203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:54620 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-350882741_1 at /127.0.0.1:37054 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:37082 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:58056 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:45165 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=916 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 299), ProcessCount=181 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=1272 (was 3068) 2023-07-20 23:10:49,852 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-20 23:10:49,874 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=181, AvailableMemoryMB=1271 2023-07-20 23:10:49,875 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-20 23:10:49,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:10:49,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:10:49,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:10:49,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 23:10:49,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:10:49,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:49,888 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:49,888 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:49,889 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e empty. 2023-07-20 23:10:49,889 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f empty. 2023-07-20 23:10:49,889 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:49,889 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:49,889 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 23:10:49,911 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 23:10:49,912 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 72f8b2e32d3322f194b347d479420c7e, NAME => 'testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:49,913 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 112b579f8bb40a017332e31341eb9b1f, NAME => 'testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:10:49,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:49,935 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:49,935 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 72f8b2e32d3322f194b347d479420c7e, disabling compactions & flushes 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 112b579f8bb40a017332e31341eb9b1f, disabling compactions & flushes 2023-07-20 23:10:49,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:49,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. after waiting 0 ms 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. after waiting 0 ms 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:49,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:49,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:49,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:49,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 72f8b2e32d3322f194b347d479420c7e: 2023-07-20 23:10:49,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 112b579f8bb40a017332e31341eb9b1f: 2023-07-20 23:10:49,940 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:10:49,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894649941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894649941"}]},"ts":"1689894649941"} 2023-07-20 23:10:49,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894649941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894649941"}]},"ts":"1689894649941"} 2023-07-20 23:10:49,944 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:10:49,945 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:10:49,945 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894649945"}]},"ts":"1689894649945"} 2023-07-20 23:10:49,947 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 23:10:49,951 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:10:49,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:10:49,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:10:49,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:10:49,953 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:10:49,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, ASSIGN}] 2023-07-20 23:10:49,956 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, ASSIGN 2023-07-20 23:10:49,956 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, ASSIGN 2023-07-20 23:10:49,958 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:10:49,958 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44911,1689894621546; forceNewPlan=false, retain=false 2023-07-20 23:10:49,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:50,108 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:10:50,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=72f8b2e32d3322f194b347d479420c7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=112b579f8bb40a017332e31341eb9b1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894650111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894650111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894650111"}]},"ts":"1689894650111"} 2023-07-20 23:10:50,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894650111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894650111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894650111"}]},"ts":"1689894650111"} 2023-07-20 23:10:50,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 72f8b2e32d3322f194b347d479420c7e, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:10:50,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 112b579f8bb40a017332e31341eb9b1f, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:10:50,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:50,268 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,268 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:10:50,270 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:10:50,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72f8b2e32d3322f194b347d479420c7e, NAME => 'testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:10:50,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. service=AccessControlService 2023-07-20 23:10:50,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:50,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:50,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,278 INFO [StoreOpener-72f8b2e32d3322f194b347d479420c7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:50,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 112b579f8bb40a017332e31341eb9b1f, NAME => 'testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:10:50,279 DEBUG [StoreOpener-72f8b2e32d3322f194b347d479420c7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf 2023-07-20 23:10:50,279 DEBUG [StoreOpener-72f8b2e32d3322f194b347d479420c7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf 2023-07-20 23:10:50,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. service=AccessControlService 2023-07-20 23:10:50,280 INFO [StoreOpener-72f8b2e32d3322f194b347d479420c7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72f8b2e32d3322f194b347d479420c7e columnFamilyName cf 2023-07-20 23:10:50,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:10:50,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:10:50,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,282 INFO [StoreOpener-72f8b2e32d3322f194b347d479420c7e-1] regionserver.HStore(310): Store=72f8b2e32d3322f194b347d479420c7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:50,283 INFO [StoreOpener-112b579f8bb40a017332e31341eb9b1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,285 DEBUG [StoreOpener-112b579f8bb40a017332e31341eb9b1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf 2023-07-20 23:10:50,285 DEBUG [StoreOpener-112b579f8bb40a017332e31341eb9b1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf 2023-07-20 23:10:50,285 INFO [StoreOpener-112b579f8bb40a017332e31341eb9b1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 112b579f8bb40a017332e31341eb9b1f columnFamilyName cf 2023-07-20 23:10:50,286 INFO [StoreOpener-112b579f8bb40a017332e31341eb9b1f-1] regionserver.HStore(310): Store=112b579f8bb40a017332e31341eb9b1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:10:50,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:10:50,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:50,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72f8b2e32d3322f194b347d479420c7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74320011, jitterRate=0.10745446383953094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:50,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72f8b2e32d3322f194b347d479420c7e: 2023-07-20 23:10:50,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:10:50,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e., pid=30, masterSystemTime=1689894650265 2023-07-20 23:10:50,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:10:50,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 112b579f8bb40a017332e31341eb9b1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73252478, jitterRate=0.09154698252677917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:10:50,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 112b579f8bb40a017332e31341eb9b1f: 2023-07-20 23:10:50,299 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=72f8b2e32d3322f194b347d479420c7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894650299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894650299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894650299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894650299"}]},"ts":"1689894650299"} 2023-07-20 23:10:50,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f., pid=31, masterSystemTime=1689894650268 2023-07-20 23:10:50,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:50,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:50,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=112b579f8bb40a017332e31341eb9b1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894650306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894650306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894650306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894650306"}]},"ts":"1689894650306"} 2023-07-20 23:10:50,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-20 23:10:50,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 72f8b2e32d3322f194b347d479420c7e, server=jenkins-hbase4.apache.org,35883,1689894621465 in 191 msec 2023-07-20 23:10:50,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, ASSIGN in 358 msec 2023-07-20 23:10:50,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-20 23:10:50,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 112b579f8bb40a017332e31341eb9b1f, server=jenkins-hbase4.apache.org,44911,1689894621546 in 197 msec 2023-07-20 23:10:50,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-20 23:10:50,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, ASSIGN in 362 msec 2023-07-20 23:10:50,318 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:10:50,319 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894650319"}]},"ts":"1689894650319"} 2023-07-20 23:10:50,320 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 23:10:50,323 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:10:50,323 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 23:10:50,325 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:50,327 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,327 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,327 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,327 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:10:50,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:50,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:50,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:50,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:10:50,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 450 msec 2023-07-20 23:10:50,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 23:10:50,490 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 23:10:50,493 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 23:10:50,494 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,495 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:50,508 DEBUG [hconnection-0x2a6c5873-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:50,514 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:50,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:50,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894650519 (current time:1689894650519). 2023-07-20 23:10:50,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:50,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x109dc6e9 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:50,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f462d77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:50,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:50,536 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:50,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x109dc6e9 to 127.0.0.1:62235 2023-07-20 23:10:50,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:50,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x19831f71 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:50,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67573826, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:50,644 DEBUG [hconnection-0x29b48c2e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:50,645 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:50,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19831f71 to 127.0.0.1:62235 2023-07-20 23:10:50,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:50,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:50,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:50,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:50,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:50,657 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:50,658 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895250658 2023-07-20 23:10:50,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 23:10:50,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:50,659 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:50,660 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:50,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:50,661 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:50,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-20 23:10:50,665 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:50,666 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895250666 2023-07-20 23:10:50,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,684 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 23:10:50,685 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:50,687 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 23:10:50,687 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:10:50,687 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,687 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,689 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,689 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,689 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,689 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,689 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,690 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,690 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,690 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:50,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:50,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:50,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:50,692 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:50,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,693 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:50,694 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:50,694 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:50,695 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:50,696 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:50,697 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:50,697 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:50,698 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,698 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:50,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:50,705 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,705 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:50,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9a91e8[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:50,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:50,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:50,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9a91e8[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:50,711 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:10:50,711 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,712 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,712 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,712 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:50,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:50,713 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:10:50,714 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:50,714 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. started... 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72f8b2e32d3322f194b347d479420c7e: 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:50,715 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:50,718 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,719 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:50,719 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:50,719 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:50,719 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:50,719 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. started... 2023-07-20 23:10:50,719 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,721 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 112b579f8bb40a017332e31341eb9b1f: 2023-07-20 23:10:50,722 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,722 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:50,722 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:10:50,722 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,722 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:50,724 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:50,724 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:50,724 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:50,735 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. completed. 2023-07-20 23:10:50,735 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,735 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:50,735 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:50,735 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,735 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:50,735 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:10:50,737 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:50,737 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,737 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:50,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:50,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:50,737 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:50,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,744 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. completed. 2023-07-20 23:10:50,744 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:50,744 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:50,744 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:50,744 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,744 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:50,744 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:10:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:10:50,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:10:50,747 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:50,747 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,747 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:50,747 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:50,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44911,1689894621546': 2023-07-20 23:10:50,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:10:50,754 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 23:10:50,754 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:50,754 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:50,754 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,754 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,758 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:50,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,759 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,760 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:50,760 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,761 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,762 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,763 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:50,763 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,764 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:50,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:50,768 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,768 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:50,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:50,767 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 23:10:50,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:50,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:10:50,770 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,771 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:10:50,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:50,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:50,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 23:10:50,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 23:10:50,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689894650658Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689894650785 (+127 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689894650785Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689894650785Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689894650795 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689894650829 (+34 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689894650866 (+37 ms) 2023-07-20 23:10:50,870 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:50,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 211 msec 2023-07-20 23:10:50,962 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:50,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:50,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:50,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:50,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44911] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:10:50,974 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 23:10:50,974 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:50,974 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:10:50,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:50,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894650990 (current time:1689894650990). 2023-07-20 23:10:50,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:10:50,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x522e31c7 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:50,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6942ee8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:51,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:51,003 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:51,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x522e31c7 to 127.0.0.1:62235 2023-07-20 23:10:51,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:51,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x73e09e77 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:10:51,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eab8bcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:10:51,020 DEBUG [hconnection-0x71ef532-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:10:51,026 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:10:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73e09e77 to 127.0.0.1:62235 2023-07-20 23:10:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:10:51,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:10:51,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:10:51,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,043 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,045 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895251045 2023-07-20 23:10:51,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:10:51,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 23:10:51,048 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:10:51,048 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:10:51,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:51,057 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:10:51,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 17 msec 2023-07-20 23:10:51,060 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:51,063 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895251063 2023-07-20 23:10:51,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 23:10:51,077 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 23:10:51,077 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,079 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 23:10:51,079 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:10:51,139 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,139 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,141 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,141 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,141 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,141 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,143 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,143 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,143 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,146 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,144 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:10:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,148 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 23:10:51,147 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,148 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 23:10:51,148 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,148 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 23:10:51,148 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:51,150 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:51,150 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:10:51,150 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,150 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,151 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,151 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:10:51,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb522c5[Count = 1] remaining members to acquire global barrier 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 23:10:51,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb522c5[Count = 0] remaining members to acquire global barrier 2023-07-20 23:10:51,157 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:10:51,158 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,159 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,159 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:10:51,160 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:51,160 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. started... 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,160 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,161 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 112b579f8bb40a017332e31341eb9b1f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:10:51,160 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:10:51,161 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:10:51,161 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:10:51,161 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:10:51,162 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:51,162 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. started... 2023-07-20 23:10:51,162 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 72f8b2e32d3322f194b347d479420c7e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:10:51,163 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,163 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,163 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,212 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5 2023-07-20 23:10:51,220 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb 2023-07-20 23:10:51,235 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/.tmp/cf/7573d1bf48f94662b1c08e8b775d791e 2023-07-20 23:10:51,242 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/.tmp/cf/2e7060a55ed6447aa68febe2e1ec478e 2023-07-20 23:10:51,243 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/.tmp/cf/7573d1bf48f94662b1c08e8b775d791e as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e 2023-07-20 23:10:51,250 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/.tmp/cf/2e7060a55ed6447aa68febe2e1ec478e as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e 2023-07-20 23:10:51,251 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 23:10:51,252 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 72f8b2e32d3322f194b347d479420c7e in 90ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:51,252 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 23:10:51,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72f8b2e32d3322f194b347d479420c7e: 2023-07-20 23:10:51,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:51,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:51,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e] hfiles 2023-07-20 23:10:51,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:51,260 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e, entries=46, sequenceid=6, filesize=12.7 K 2023-07-20 23:10:51,262 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 112b579f8bb40a017332e31341eb9b1f in 102ms, sequenceid=6, compaction requested=false 2023-07-20 23:10:51,272 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 112b579f8bb40a017332e31341eb9b1f: 2023-07-20 23:10:51,273 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:51,273 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:10:51,273 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e] hfiles 2023-07-20 23:10:51,273 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:51,279 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. completed. 2023-07-20 23:10:51,279 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:10:51,279 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:51,279 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:51,279 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,279 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,279 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:10:51,286 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,286 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,286 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,287 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:10:51,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:10:51,301 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. completed. 2023-07-20 23:10:51,301 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:10:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:10:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:10:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 23:10:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:10:51,303 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 23:10:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 23:10:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44911,1689894621546': 2023-07-20 23:10:51,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:10:51,308 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 23:10:51,308 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:10:51,308 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:10:51,308 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 23:10:51,308 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:10:51,310 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,310 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,310 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,311 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:10:51,311 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,312 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:10:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,312 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:10:51,314 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 23:10:51,315 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,315 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,319 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,319 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:10:51,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,318 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:10:51,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,319 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 23:10:51,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 23:10:51,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:10:51,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:10:51,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 23:10:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:10:51,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,321 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:10:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:10:51,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5] mob files 2023-07-20 23:10:51,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb 2023-07-20 23:10:51,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5 2023-07-20 23:10:51,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 23:10:51,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,350 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:51,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:51,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:10:51,352 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:10:51,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 23:10:51,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,385 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689894651046Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689894651333 (+287 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689894651333Loading Region manifests for snaptb0-testExportFileSystemState at 1689894651333Writing data manifest for snaptb0-testExportFileSystemState at 1689894651341 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689894651354 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689894651384 (+30 ms) 2023-07-20 23:10:51,388 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 23:10:51,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 340 msec 2023-07-20 23:10:51,652 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:10:51,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:10:51,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:10:51,654 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654 2023-07-20 23:10:51,654 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33859, tgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654, rawTgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:51,678 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:10:51,678 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-710695140_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,678 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 23:10:51,692 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 23:10:51,718 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,718 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,719 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,719 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,719 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,720 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,720 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,802 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-7535810889840321693.jar 2023-07-20 23:10:51,803 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,803 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,804 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,804 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,804 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,805 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:10:51,805 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:10:51,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:10:51,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:10:51,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:10:51,807 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:10:51,807 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:10:51,808 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:10:51,809 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:10:51,809 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:10:51,810 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:10:51,811 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:51,811 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:51,812 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:51,812 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:51,812 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:10:51,813 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:51,813 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:10:52,467 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:10:52,470 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 23:10:52,473 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 23:10:53,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:53,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:10:53,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0001_000001 (auth:SIMPLE) 2023-07-20 23:10:53,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0002_000001 (auth:SIMPLE) 2023-07-20 23:10:55,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:10:58,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:00,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:04,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:05,699 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:05,700 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:05,714 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 23:11:05,714 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:05,715 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:05,715 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:11:05,722 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 23:11:05,722 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 23:11:05,722 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 23:11:05,723 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 23:11:05,723 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894651654/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 23:11:05,741 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 23:11:05,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 23:11:05,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:05,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894665747"}]},"ts":"1689894665747"} 2023-07-20 23:11:05,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:05,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 23:11:05,751 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 23:11:05,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, UNASSIGN}] 2023-07-20 23:11:05,754 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, UNASSIGN 2023-07-20 23:11:05,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, UNASSIGN 2023-07-20 23:11:05,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=72f8b2e32d3322f194b347d479420c7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:05,756 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894665755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894665755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894665755"}]},"ts":"1689894665755"} 2023-07-20 23:11:05,755 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=112b579f8bb40a017332e31341eb9b1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:05,756 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894665755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894665755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894665755"}]},"ts":"1689894665755"} 2023-07-20 23:11:05,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 72f8b2e32d3322f194b347d479420c7e, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:05,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 112b579f8bb40a017332e31341eb9b1f, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:11:05,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:05,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72f8b2e32d3322f194b347d479420c7e, disabling compactions & flushes 2023-07-20 23:11:05,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:11:05,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. after waiting 0 ms 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 112b579f8bb40a017332e31341eb9b1f, disabling compactions & flushes 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:11:05,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. after waiting 0 ms 2023-07-20 23:11:05,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:11:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:05,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:05,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:05,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e. 2023-07-20 23:11:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72f8b2e32d3322f194b347d479420c7e: 2023-07-20 23:11:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f. 2023-07-20 23:11:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 112b579f8bb40a017332e31341eb9b1f: 2023-07-20 23:11:05,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:11:05,934 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=72f8b2e32d3322f194b347d479420c7e, regionState=CLOSED 2023-07-20 23:11:05,935 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894665934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894665934"}]},"ts":"1689894665934"} 2023-07-20 23:11:05,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:11:05,935 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=112b579f8bb40a017332e31341eb9b1f, regionState=CLOSED 2023-07-20 23:11:05,935 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689894665935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894665935"}]},"ts":"1689894665935"} 2023-07-20 23:11:05,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-20 23:11:05,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 72f8b2e32d3322f194b347d479420c7e, server=jenkins-hbase4.apache.org,35883,1689894621465 in 179 msec 2023-07-20 23:11:05,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-20 23:11:05,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 112b579f8bb40a017332e31341eb9b1f, server=jenkins-hbase4.apache.org,44911,1689894621546 in 178 msec 2023-07-20 23:11:05,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=72f8b2e32d3322f194b347d479420c7e, UNASSIGN in 189 msec 2023-07-20 23:11:05,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-20 23:11:05,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=112b579f8bb40a017332e31341eb9b1f, UNASSIGN in 190 msec 2023-07-20 23:11:05,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894665944"}]},"ts":"1689894665944"} 2023-07-20 23:11:05,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 23:11:05,950 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 23:11:05,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-20 23:11:06,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 23:11:06,050 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 23:11:06,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 23:11:06,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,054 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 23:11:06,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,056 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 23:11:06,060 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:11:06,060 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:11:06,061 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,061 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,061 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,061 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:06,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:06,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:06,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 23:11:06,062 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/recovered.edits] 2023-07-20 23:11:06,062 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/recovered.edits] 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,063 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 23:11:06,067 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/cf/7573d1bf48f94662b1c08e8b775d791e 2023-07-20 23:11:06,067 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/cf/2e7060a55ed6447aa68febe2e1ec478e 2023-07-20 23:11:06,070 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e/recovered.edits/9.seqid 2023-07-20 23:11:06,070 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f/recovered.edits/9.seqid 2023-07-20 23:11:06,070 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/72f8b2e32d3322f194b347d479420c7e 2023-07-20 23:11:06,070 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemState/112b579f8bb40a017332e31341eb9b1f 2023-07-20 23:11:06,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 23:11:06,071 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 23:11:06,072 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-20 23:11:06,075 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307200833cbf0ad3e4ebc9a920478197852bb 2023-07-20 23:11:06,076 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307201d64733d34014a3d9dba3786f3cdd9d5 2023-07-20 23:11:06,076 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 23:11:06,079 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,082 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 23:11:06,084 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 23:11:06,085 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,085 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 23:11:06,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894666086"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:06,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894666086"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:06,088 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:11:06,088 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 72f8b2e32d3322f194b347d479420c7e, NAME => 'testtb-testExportFileSystemState,,1689894649876.72f8b2e32d3322f194b347d479420c7e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 112b579f8bb40a017332e31341eb9b1f, NAME => 'testtb-testExportFileSystemState,1,1689894649876.112b579f8bb40a017332e31341eb9b1f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:11:06,088 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 23:11:06,088 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894666088"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:06,089 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 23:11:06,092 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 23:11:06,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-20 23:11:06,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 23:11:06,165 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 23:11:06,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 23:11:06,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 23:11:06,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 23:11:06,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 23:11:06,204 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:53062 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1532981945_1 at /127.0.0.1:40548 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:36083 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:45161 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1532981945_1 at /127.0.0.1:35288 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:35332 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:40564 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1134 (was 1271) 2023-07-20 23:11:06,204 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-20 23:11:06,224 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=181, AvailableMemoryMB=1133 2023-07-20 23:11:06,225 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-20 23:11:06,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:11:06,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:06,230 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:06,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 23:11:06,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:06,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:06,234 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,234 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,234 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 empty. 2023-07-20 23:11:06,234 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 empty. 2023-07-20 23:11:06,235 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,235 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,235 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 23:11:06,245 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:06,247 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9a8a65470bf98df18136096aba51479, NAME => 'testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:06,247 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => eef0659cabc074889813a3e6ea7789d6, NAME => 'testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d9a8a65470bf98df18136096aba51479, disabling compactions & flushes 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:06,268 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing eef0659cabc074889813a3e6ea7789d6, disabling compactions & flushes 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,268 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. after waiting 0 ms 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,268 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. after waiting 0 ms 2023-07-20 23:11:06,269 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,269 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,269 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d9a8a65470bf98df18136096aba51479: 2023-07-20 23:11:06,269 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,269 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for eef0659cabc074889813a3e6ea7789d6: 2023-07-20 23:11:06,271 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:06,272 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894666272"}]},"ts":"1689894666272"} 2023-07-20 23:11:06,272 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894666272"}]},"ts":"1689894666272"} 2023-07-20 23:11:06,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:06,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:06,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894666276"}]},"ts":"1689894666276"} 2023-07-20 23:11:06,277 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 23:11:06,284 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:06,285 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:06,286 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:06,286 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:06,286 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:06,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, ASSIGN}] 2023-07-20 23:11:06,289 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, ASSIGN 2023-07-20 23:11:06,289 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, ASSIGN 2023-07-20 23:11:06,290 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:11:06,290 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:11:06,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:06,440 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:06,443 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d9a8a65470bf98df18136096aba51479, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=eef0659cabc074889813a3e6ea7789d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,443 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894666442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894666442"}]},"ts":"1689894666442"} 2023-07-20 23:11:06,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894666442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894666442"}]},"ts":"1689894666442"} 2023-07-20 23:11:06,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure d9a8a65470bf98df18136096aba51479, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:11:06,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure eef0659cabc074889813a3e6ea7789d6, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:06,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:06,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eef0659cabc074889813a3e6ea7789d6, NAME => 'testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:11:06,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9a8a65470bf98df18136096aba51479, NAME => 'testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. service=AccessControlService 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. service=AccessControlService 2023-07-20 23:11:06,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:06,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,606 INFO [StoreOpener-eef0659cabc074889813a3e6ea7789d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,606 INFO [StoreOpener-d9a8a65470bf98df18136096aba51479-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,607 DEBUG [StoreOpener-eef0659cabc074889813a3e6ea7789d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf 2023-07-20 23:11:06,607 DEBUG [StoreOpener-eef0659cabc074889813a3e6ea7789d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf 2023-07-20 23:11:06,607 DEBUG [StoreOpener-d9a8a65470bf98df18136096aba51479-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf 2023-07-20 23:11:06,607 DEBUG [StoreOpener-d9a8a65470bf98df18136096aba51479-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf 2023-07-20 23:11:06,607 INFO [StoreOpener-eef0659cabc074889813a3e6ea7789d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eef0659cabc074889813a3e6ea7789d6 columnFamilyName cf 2023-07-20 23:11:06,607 INFO [StoreOpener-d9a8a65470bf98df18136096aba51479-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9a8a65470bf98df18136096aba51479 columnFamilyName cf 2023-07-20 23:11:06,609 INFO [StoreOpener-eef0659cabc074889813a3e6ea7789d6-1] regionserver.HStore(310): Store=eef0659cabc074889813a3e6ea7789d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:06,609 INFO [StoreOpener-d9a8a65470bf98df18136096aba51479-1] regionserver.HStore(310): Store=d9a8a65470bf98df18136096aba51479/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:06,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:06,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:06,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:06,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:06,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eef0659cabc074889813a3e6ea7789d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62844913, jitterRate=-0.06353782117366791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:06,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eef0659cabc074889813a3e6ea7789d6: 2023-07-20 23:11:06,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9a8a65470bf98df18136096aba51479; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61026026, jitterRate=-0.09064134955406189}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:06,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9a8a65470bf98df18136096aba51479: 2023-07-20 23:11:06,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479., pid=45, masterSystemTime=1689894666597 2023-07-20 23:11:06,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6., pid=46, masterSystemTime=1689894666597 2023-07-20 23:11:06,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d9a8a65470bf98df18136096aba51479, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666618"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894666618"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894666618"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894666618"}]},"ts":"1689894666618"} 2023-07-20 23:11:06,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=eef0659cabc074889813a3e6ea7789d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894666620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894666620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894666620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894666620"}]},"ts":"1689894666620"} 2023-07-20 23:11:06,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-20 23:11:06,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure d9a8a65470bf98df18136096aba51479, server=jenkins-hbase4.apache.org,33297,1689894621380 in 176 msec 2023-07-20 23:11:06,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-20 23:11:06,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure eef0659cabc074889813a3e6ea7789d6, server=jenkins-hbase4.apache.org,35883,1689894621465 in 176 msec 2023-07-20 23:11:06,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, ASSIGN in 337 msec 2023-07-20 23:11:06,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-20 23:11:06,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, ASSIGN in 338 msec 2023-07-20 23:11:06,627 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:06,627 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894666627"}]},"ts":"1689894666627"} 2023-07-20 23:11:06,628 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 23:11:06,631 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:06,631 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 23:11:06,633 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:06,634 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,634 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,635 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,634 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:06,637 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:06,637 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:06,637 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:06,637 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:06,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 410 msec 2023-07-20 23:11:06,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 23:11:06,835 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 23:11:06,838 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 23:11:06,838 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,841 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:06,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:06,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894666854 (current time:1689894666854). 2023-07-20 23:11:06,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x3c074915 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:06,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e92ebcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:06,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:06,865 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:06,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c074915 to 127.0.0.1:62235 2023-07-20 23:11:06,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:06,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x1782c307 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:06,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11cb6f03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:06,874 DEBUG [hconnection-0x48de2a7d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:06,876 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:06,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1782c307 to 127.0.0.1:62235 2023-07-20 23:11:06,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:06,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:06,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:06,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:06,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:06,885 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:06,885 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689895266885 2023-07-20 23:11:06,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:06,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 23:11:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:06,887 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:06,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:06,890 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:06,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-20 23:11:06,893 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:06,893 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689895266893 2023-07-20 23:11:06,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,905 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 23:11:06,905 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:06,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 23:11:06,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 23:11:06,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,910 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:06,910 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:06,910 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,910 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:06,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:06,913 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:06,914 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:06,914 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:06,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:06,918 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:06,918 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:06,918 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:06,919 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,919 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,919 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:06,920 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,920 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@471c2a84[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:06,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:06,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:06,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@471c2a84[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:06,924 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 23:11:06,924 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,925 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:06,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,926 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,925 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. started... 2023-07-20 23:11:06,926 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,926 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:06,926 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:06,926 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eef0659cabc074889813a3e6ea7789d6: 2023-07-20 23:11:06,926 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:06,927 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:06,927 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:11:06,926 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. started... 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d9a8a65470bf98df18136096aba51479: 2023-07-20 23:11:06,927 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,928 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:06,928 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:06,935 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:06,935 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:06,935 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:06,948 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. completed. 2023-07-20 23:11:06,948 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:06,949 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:06,949 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:06,949 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,949 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:06,949 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:11:06,951 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,951 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:06,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:06,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:06,951 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:06,951 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:06,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:06,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:06,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:11:06,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 23:11:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:06,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:06,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:06,988 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:07,189 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:07,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:07,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:07,190 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:11:07,350 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. completed. 2023-07-20 23:11:07,350 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:07,350 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:07,351 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:07,351 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,351 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:07,351 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:11:07,352 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,352 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:07,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:07,352 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:07,353 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:07,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:11:07,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 23:11:07,358 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 23:11:07,358 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:07,358 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:07,358 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,358 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:07,359 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:07,360 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,360 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,361 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,361 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,363 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:07,364 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,364 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,367 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:07,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:11:07,368 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:07,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,370 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,370 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,370 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,370 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:07,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:07,370 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,371 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,371 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:11:07,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 23:11:07,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,423 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:07,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689894666886Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689894667381 (+495 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689894667381Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689894667381Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689894667384 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689894667395 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689894667422 (+27 ms) 2023-07-20 23:11:07,426 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:07,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 539 msec 2023-07-20 23:11:07,491 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:07,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:07,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:07,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:07,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:07,499 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 23:11:07,500 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:07,500 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:07,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:07,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894667512 (current time:1689894667512). 2023-07-20 23:11:07,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:07,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x39296900 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:07,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49f0e064, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:07,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:07,531 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:07,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39296900 to 127.0.0.1:62235 2023-07-20 23:11:07,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:07,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x5208d740 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@201bc568, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:07,551 DEBUG [hconnection-0x6e26e2cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:07,552 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:07,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5208d740 to 127.0.0.1:62235 2023-07-20 23:11:07,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:07,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 23:11:07,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:07,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:07,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:07,563 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:07,566 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689895267566 2023-07-20 23:11:07,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 23:11:07,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 23:11:07,567 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:07,568 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:07,569 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 23:11:07,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:07,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 23:11:07,572 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:07,573 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689895267573 2023-07-20 23:11:07,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 23:11:07,584 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 23:11:07,584 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:07,586 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 23:11:07,586 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 23:11:07,587 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,587 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,589 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,589 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:07,589 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,589 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,590 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,590 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:07,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:07,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 23:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:07,595 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:07,595 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:07,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 23:11:07,595 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:07,595 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 23:11:07,595 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:07,596 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:07,596 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:07,598 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 23:11:07,602 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,602 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:07,604 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:07,605 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b5c56c[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 23:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b5c56c[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:07,610 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 23:11:07,611 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:07,612 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:07,612 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 23:11:07,612 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:07,613 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:07,613 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:07,612 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:07,613 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. started... 2023-07-20 23:11:07,613 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:07,613 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:07,613 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. started... 2023-07-20 23:11:07,613 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:07,613 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:07,613 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:07,613 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:11:07,613 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d9a8a65470bf98df18136096aba51479 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:11:07,613 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eef0659cabc074889813a3e6ea7789d6 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:11:07,615 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:07,615 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:07,615 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:07,644 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459 2023-07-20 23:11:07,644 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f 2023-07-20 23:11:07,668 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:07,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:07,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:07,669 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:07,869 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:07,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:07,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:07,870 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:11:08,053 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/.tmp/cf/a4e335f5c3c8473b9e37c36d4b8bd554 2023-07-20 23:11:08,053 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/.tmp/cf/bf227502c2b14c0b8164a2d1a7fd6980 2023-07-20 23:11:08,060 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/.tmp/cf/bf227502c2b14c0b8164a2d1a7fd6980 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980 2023-07-20 23:11:08,060 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/.tmp/cf/a4e335f5c3c8473b9e37c36d4b8bd554 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554 2023-07-20 23:11:08,066 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980, entries=46, sequenceid=6, filesize=12.5 K 2023-07-20 23:11:08,066 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554, entries=4, sequenceid=6, filesize=5.5 K 2023-07-20 23:11:08,067 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for eef0659cabc074889813a3e6ea7789d6 in 454ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:08,067 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d9a8a65470bf98df18136096aba51479 in 454ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:08,067 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 23:11:08,067 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eef0659cabc074889813a3e6ea7789d6: 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d9a8a65470bf98df18136096aba51479: 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554] hfiles 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980] hfiles 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:08,069 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:08,087 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. completed. 2023-07-20 23:11:08,087 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:08,087 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:08,087 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:08,087 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,087 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:08,087 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:11:08,090 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. completed. 2023-07-20 23:11:08,090 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:11:08,090 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,090 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:08,092 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,092 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 23:11:08,092 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,092 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 23:11:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:11:08,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 23:11:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:11:08,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 23:11:08,102 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 23:11:08,102 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:08,102 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:08,102 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 23:11:08,102 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,104 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,105 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:08,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,105 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,106 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,107 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:08,108 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 23:11:08,109 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,109 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 23:11:08,117 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,117 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,117 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,117 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,116 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,119 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,117 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:08,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 23:11:08,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:08,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:11:08,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,119 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:08,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,119 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:08,120 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:08,120 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:08,120 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,120 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:08,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f] mob files 2023-07-20 23:11:08,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459 2023-07-20 23:11:08,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f 2023-07-20 23:11:08,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 23:11:08,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,171 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:08,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:08,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:08,172 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:11:08,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 23:11:08,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,206 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689894667566Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689894668134 (+568 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689894668134Loading Region manifests for snaptb0-testConsecutiveExports at 1689894668134Writing data manifest for snaptb0-testConsecutiveExports at 1689894668139 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689894668149 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689894668206 (+57 ms) 2023-07-20 23:11:08,209 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 23:11:08,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 642 msec 2023-07-20 23:11:08,672 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 23:11:08,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:08,674 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674 2023-07-20 23:11:08,674 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:08,699 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:08,699 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@417b94a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,699 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 23:11:08,710 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:08,725 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,725 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,725 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,726 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,727 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,803 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-1137543949023487527.jar 2023-07-20 23:11:08,804 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,804 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,805 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,805 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,805 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:08,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:08,807 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:08,807 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:08,808 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:08,808 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:08,809 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:08,809 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:08,810 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:08,810 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:08,810 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:08,811 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:08,811 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:08,812 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:08,812 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:08,813 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:08,813 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:08,814 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:09,337 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:09,340 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 23:11:09,343 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 23:11:10,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:10,473 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:10,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0002_000001 (auth:SIMPLE) 2023-07-20 23:11:11,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:11,526 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:11:15,642 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:17,880 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:20,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:22,571 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:22,572 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:22,576 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 23:11:22,576 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:22,577 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:22,577 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,578 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:22,578 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:22,578 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,578 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:22,578 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:22,579 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:22,601 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:22,601 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1fc88a68, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,601 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 23:11:22,610 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 23:11:22,621 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,622 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,623 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,623 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,623 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,623 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,692 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-786891573049610635.jar 2023-07-20 23:11:22,692 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,693 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,693 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,693 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,693 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,694 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:22,694 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:22,695 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:22,695 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:22,695 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:22,696 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:22,696 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:22,696 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:22,697 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:22,697 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:22,698 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:22,698 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:22,698 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:22,699 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:22,699 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:22,699 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:22,700 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:22,700 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:23,185 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:23,188 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 23:11:23,190 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 23:11:26,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:26,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:26,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0003_000001 (auth:SIMPLE) 2023-07-20 23:11:27,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:31,740 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:33,974 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:37,350 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:38,467 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:11:38,467 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:11:38,475 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 23:11:38,476 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:11:38,476 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:11:38,476 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:38,481 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:38,481 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:38,481 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 23:11:38,482 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 23:11:38,482 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/local-export-1689894668674/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 23:11:38,502 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 23:11:38,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 23:11:38,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894698509"}]},"ts":"1689894698509"} 2023-07-20 23:11:38,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:38,511 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 23:11:38,519 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 23:11:38,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, UNASSIGN}] 2023-07-20 23:11:38,521 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, UNASSIGN 2023-07-20 23:11:38,524 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, UNASSIGN 2023-07-20 23:11:38,525 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d9a8a65470bf98df18136096aba51479, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:38,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=eef0659cabc074889813a3e6ea7789d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:38,526 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894698525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894698525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894698525"}]},"ts":"1689894698525"} 2023-07-20 23:11:38,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894698525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894698525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894698525"}]},"ts":"1689894698525"} 2023-07-20 23:11:38,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure d9a8a65470bf98df18136096aba51479, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:11:38,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure eef0659cabc074889813a3e6ea7789d6, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:38,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:38,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:38,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9a8a65470bf98df18136096aba51479, disabling compactions & flushes 2023-07-20 23:11:38,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:38,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:38,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. after waiting 0 ms 2023-07-20 23:11:38,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:38,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:38,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eef0659cabc074889813a3e6ea7789d6, disabling compactions & flushes 2023-07-20 23:11:38,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:38,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:38,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. after waiting 0 ms 2023-07-20 23:11:38,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:38,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:38,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:38,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479. 2023-07-20 23:11:38,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9a8a65470bf98df18136096aba51479: 2023-07-20 23:11:38,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:38,727 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d9a8a65470bf98df18136096aba51479, regionState=CLOSED 2023-07-20 23:11:38,727 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894698727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894698727"}]},"ts":"1689894698727"} 2023-07-20 23:11:38,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-20 23:11:38,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure d9a8a65470bf98df18136096aba51479, server=jenkins-hbase4.apache.org,33297,1689894621380 in 202 msec 2023-07-20 23:11:38,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d9a8a65470bf98df18136096aba51479, UNASSIGN in 212 msec 2023-07-20 23:11:38,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:11:38,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:38,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6. 2023-07-20 23:11:38,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eef0659cabc074889813a3e6ea7789d6: 2023-07-20 23:11:38,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:38,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=eef0659cabc074889813a3e6ea7789d6, regionState=CLOSED 2023-07-20 23:11:38,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689894698746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894698746"}]},"ts":"1689894698746"} 2023-07-20 23:11:38,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-20 23:11:38,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure eef0659cabc074889813a3e6ea7789d6, server=jenkins-hbase4.apache.org,35883,1689894621465 in 221 msec 2023-07-20 23:11:38,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-20 23:11:38,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=eef0659cabc074889813a3e6ea7789d6, UNASSIGN in 238 msec 2023-07-20 23:11:38,761 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894698761"}]},"ts":"1689894698761"} 2023-07-20 23:11:38,763 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 23:11:38,765 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 23:11:38,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 263 msec 2023-07-20 23:11:38,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 23:11:38,813 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 23:11:38,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 23:11:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,817 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 23:11:38,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,822 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 23:11:38,824 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,825 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,825 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,825 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:38,826 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,826 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 23:11:38,826 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:38,826 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:38,829 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/recovered.edits] 2023-07-20 23:11:38,829 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/recovered.edits] 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:38,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-20 23:11:38,830 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:11:38,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-20 23:11:38,830 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:11:38,830 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:38,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 23:11:38,835 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/cf/bf227502c2b14c0b8164a2d1a7fd6980 2023-07-20 23:11:38,836 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/cf/a4e335f5c3c8473b9e37c36d4b8bd554 2023-07-20 23:11:38,850 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479/recovered.edits/9.seqid 2023-07-20 23:11:38,851 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/d9a8a65470bf98df18136096aba51479 2023-07-20 23:11:38,855 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6/recovered.edits/9.seqid 2023-07-20 23:11:38,855 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testConsecutiveExports/eef0659cabc074889813a3e6ea7789d6 2023-07-20 23:11:38,856 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 23:11:38,856 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 23:11:38,857 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-20 23:11:38,862 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720e9680ced9b9647948b5cf74f866d3459 2023-07-20 23:11:38,864 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023072071a4c729094e4c34bf7112a707e8bf5f 2023-07-20 23:11:38,864 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 23:11:38,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,871 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 23:11:38,876 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 23:11:38,879 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,879 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 23:11:38,879 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894698879"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:38,879 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894698879"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:38,882 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:11:38,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d9a8a65470bf98df18136096aba51479, NAME => 'testtb-testConsecutiveExports,,1689894666226.d9a8a65470bf98df18136096aba51479.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => eef0659cabc074889813a3e6ea7789d6, NAME => 'testtb-testConsecutiveExports,1,1689894666226.eef0659cabc074889813a3e6ea7789d6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:11:38,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 23:11:38,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894698882"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:38,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 23:11:38,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 23:11:38,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 77 msec 2023-07-20 23:11:38,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 23:11:38,933 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 23:11:38,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 23:11:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 23:11:38,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 23:11:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 23:11:38,984 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 762), OpenFileDescriptor=915 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 297), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=1571 (was 1133) - AvailableMemoryMB LEAK? - 2023-07-20 23:11:38,984 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-20 23:11:39,015 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=183, AvailableMemoryMB=1565 2023-07-20 23:11:39,015 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-20 23:11:39,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:11:39,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,022 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:39,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 23:11:39,024 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:39,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:39,027 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,027 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,028 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 empty. 2023-07-20 23:11:39,028 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 empty. 2023-07-20 23:11:39,028 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,028 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,028 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 23:11:39,079 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:39,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1196b05333b5bace8e942838215dbed8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:39,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 17e5988ab5f1af8a1be33c1df0d50097, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:39,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:39,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1196b05333b5bace8e942838215dbed8, disabling compactions & flushes 2023-07-20 23:11:39,102 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. after waiting 0 ms 2023-07-20 23:11:39,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,103 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,103 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1196b05333b5bace8e942838215dbed8: 2023-07-20 23:11:39,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:39,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 17e5988ab5f1af8a1be33c1df0d50097, disabling compactions & flushes 2023-07-20 23:11:39,105 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. after waiting 0 ms 2023-07-20 23:11:39,105 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 17e5988ab5f1af8a1be33c1df0d50097: 2023-07-20 23:11:39,108 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:39,109 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894699109"}]},"ts":"1689894699109"} 2023-07-20 23:11:39,110 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894699109"}]},"ts":"1689894699109"} 2023-07-20 23:11:39,112 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:39,113 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:39,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894699113"}]},"ts":"1689894699113"} 2023-07-20 23:11:39,115 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 23:11:39,120 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:39,122 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:39,122 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:39,122 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:39,122 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:39,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, ASSIGN}] 2023-07-20 23:11:39,127 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, ASSIGN 2023-07-20 23:11:39,127 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, ASSIGN 2023-07-20 23:11:39,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:39,128 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:11:39,128 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44911,1689894621546; forceNewPlan=false, retain=false 2023-07-20 23:11:39,279 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:39,282 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1196b05333b5bace8e942838215dbed8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=17e5988ab5f1af8a1be33c1df0d50097, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,283 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894699282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894699282"}]},"ts":"1689894699282"} 2023-07-20 23:11:39,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894699282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894699282"}]},"ts":"1689894699282"} 2023-07-20 23:11:39,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 1196b05333b5bace8e942838215dbed8, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:39,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 17e5988ab5f1af8a1be33c1df0d50097, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:11:39,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:39,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1196b05333b5bace8e942838215dbed8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:11:39,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. service=AccessControlService 2023-07-20 23:11:39,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:39,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:39,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,450 INFO [StoreOpener-1196b05333b5bace8e942838215dbed8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17e5988ab5f1af8a1be33c1df0d50097, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:11:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. service=AccessControlService 2023-07-20 23:11:39,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,455 INFO [StoreOpener-17e5988ab5f1af8a1be33c1df0d50097-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,457 DEBUG [StoreOpener-17e5988ab5f1af8a1be33c1df0d50097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf 2023-07-20 23:11:39,457 DEBUG [StoreOpener-17e5988ab5f1af8a1be33c1df0d50097-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf 2023-07-20 23:11:39,458 INFO [StoreOpener-17e5988ab5f1af8a1be33c1df0d50097-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17e5988ab5f1af8a1be33c1df0d50097 columnFamilyName cf 2023-07-20 23:11:39,465 INFO [StoreOpener-17e5988ab5f1af8a1be33c1df0d50097-1] regionserver.HStore(310): Store=17e5988ab5f1af8a1be33c1df0d50097/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:39,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:11:39,476 DEBUG [StoreOpener-1196b05333b5bace8e942838215dbed8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf 2023-07-20 23:11:39,476 DEBUG [StoreOpener-1196b05333b5bace8e942838215dbed8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf 2023-07-20 23:11:39,477 INFO [StoreOpener-1196b05333b5bace8e942838215dbed8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1196b05333b5bace8e942838215dbed8 columnFamilyName cf 2023-07-20 23:11:39,478 INFO [StoreOpener-1196b05333b5bace8e942838215dbed8-1] regionserver.HStore(310): Store=1196b05333b5bace8e942838215dbed8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:39,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:39,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17e5988ab5f1af8a1be33c1df0d50097; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72504629, jitterRate=0.0804031640291214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:39,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17e5988ab5f1af8a1be33c1df0d50097: 2023-07-20 23:11:39,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097., pid=61, masterSystemTime=1689894699441 2023-07-20 23:11:39,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1196b05333b5bace8e942838215dbed8 2023-07-20 23:11:39,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=17e5988ab5f1af8a1be33c1df0d50097, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894699495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894699495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894699495"}]},"ts":"1689894699495"} 2023-07-20 23:11:39,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-20 23:11:39,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 17e5988ab5f1af8a1be33c1df0d50097, server=jenkins-hbase4.apache.org,44911,1689894621546 in 211 msec 2023-07-20 23:11:39,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, ASSIGN in 379 msec 2023-07-20 23:11:39,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:39,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1196b05333b5bace8e942838215dbed8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60583846, jitterRate=-0.09723034501075745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:39,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1196b05333b5bace8e942838215dbed8: 2023-07-20 23:11:39,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8., pid=60, masterSystemTime=1689894699438 2023-07-20 23:11:39,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1196b05333b5bace8e942838215dbed8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,516 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894699516"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894699516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894699516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894699516"}]},"ts":"1689894699516"} 2023-07-20 23:11:39,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-20 23:11:39,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 1196b05333b5bace8e942838215dbed8, server=jenkins-hbase4.apache.org,35883,1689894621465 in 233 msec 2023-07-20 23:11:39,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-20 23:11:39,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, ASSIGN in 398 msec 2023-07-20 23:11:39,522 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:39,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894699522"}]},"ts":"1689894699522"} 2023-07-20 23:11:39,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 23:11:39,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:39,534 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 23:11:39,536 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:39,538 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:39,538 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:39,538 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:39,538 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:39,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:39,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:39,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:39,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:39,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 523 msec 2023-07-20 23:11:39,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 23:11:39,632 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 23:11:39,634 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,635 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,637 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:39,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894699717 (current time:1689894699717). 2023-07-20 23:11:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x520a2dbd to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:39,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d883dbb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:39,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:39,756 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:39,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x520a2dbd to 127.0.0.1:62235 2023-07-20 23:11:39,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:39,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x71e9d3b3 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720d7ff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:39,864 DEBUG [hconnection-0xe94e1e9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:39,867 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71e9d3b3 to 127.0.0.1:62235 2023-07-20 23:11:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:39,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:39,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:39,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:39,877 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:39,878 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689895299878 2023-07-20 23:11:39,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:39,879 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:39,879 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:39,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:39,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:39,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-20 23:11:39,884 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:39,885 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689895299885 2023-07-20 23:11:39,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,902 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:39,902 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:39,903 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 23:11:39,903 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 23:11:39,904 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,904 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,906 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:39,906 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:39,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:39,906 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:39,907 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:39,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:39,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,907 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:39,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,908 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:39,909 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:39,909 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:39,909 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:39,910 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:39,912 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:39,912 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:39,912 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:39,913 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:39,914 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,914 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:39,915 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,915 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,915 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,915 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:39,916 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,916 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:39,916 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,916 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:39,916 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4907c3[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:39,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:39,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4907c3[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:39,920 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 23:11:39,920 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:39,921 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:39,921 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:39,921 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,921 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:11:39,921 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:39,922 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:39,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,922 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. started... 2023-07-20 23:11:39,922 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,922 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:39,922 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1196b05333b5bace8e942838215dbed8: 2023-07-20 23:11:39,922 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:39,922 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. started... 2023-07-20 23:11:39,922 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:39,923 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:39,931 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17e5988ab5f1af8a1be33c1df0d50097: 2023-07-20 23:11:39,931 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,931 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:39,931 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:11:39,934 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:39,934 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:39,934 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:39,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:39,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:39,983 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:39,984 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. completed. 2023-07-20 23:11:39,984 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:39,984 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:39,985 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:39,988 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:39,991 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,991 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. completed. 2023-07-20 23:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,991 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,992 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:39,992 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:11:39,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:39,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:39,995 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:39,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,995 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44911,1689894621546': 2023-07-20 23:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 23:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:11:40,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 23:11:40,006 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 23:11:40,006 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:40,006 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:40,006 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,006 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:40,008 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,008 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,008 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,008 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,008 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,009 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,009 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,010 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,012 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,013 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,013 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,022 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,022 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,024 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,025 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,025 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,025 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,025 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-20 23:11:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-20 23:11:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,026 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,026 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,026 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,026 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:40,026 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,026 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,027 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,027 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,027 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,027 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,027 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:11:40,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:11:40,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 23:11:40,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,143 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689894699878Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689894700071 (+193 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894700071Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894700071Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894700077 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689894700091 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689894700142 (+51 ms) 2023-07-20 23:11:40,147 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:40,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 268 msec 2023-07-20 23:11:40,183 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:40,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:40,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:40,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44911] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:40,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:11:40,200 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,200 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:40,201 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:11:40,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:40,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894700220 (current time:1689894700220). 2023-07-20 23:11:40,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:40,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x38fbcc35 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:40,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40212097, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:40,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:40,229 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:40,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38fbcc35 to 127.0.0.1:62235 2023-07-20 23:11:40,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x00eb7d29 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:40,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66179365, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:40,240 DEBUG [hconnection-0x2f7b32a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:40,243 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:40,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00eb7d29 to 127.0.0.1:62235 2023-07-20 23:11:40,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:40,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 23:11:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:40,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:40,255 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:40,256 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689895300256 2023-07-20 23:11:40,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 23:11:40,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,258 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:40,258 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:40,260 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 23:11:40,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:40,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-20 23:11:40,262 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:40,263 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689895300263 2023-07-20 23:11:40,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,297 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:40,297 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:40,302 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 23:11:40,302 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 23:11:40,302 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,302 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,304 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,304 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,304 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,304 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,305 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,305 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,306 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,306 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,307 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:40,307 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 23:11:40,307 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:40,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:40,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,314 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 23:11:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 23:11:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 23:11:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 23:11:40,320 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,320 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,321 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,321 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:40,321 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,321 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,321 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:40,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2cb5a5[Count = 1] remaining members to acquire global barrier 2023-07-20 23:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 23:11:40,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2cb5a5[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:40,335 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 23:11:40,335 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,336 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:11:40,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 23:11:40,340 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,340 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,340 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:40,342 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:40,346 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:40,347 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:40,356 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:40,356 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:40,356 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:40,356 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. started... 2023-07-20 23:11:40,357 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1196b05333b5bace8e942838215dbed8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 23:11:40,358 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:40,359 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. started... 2023-07-20 23:11:40,359 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17e5988ab5f1af8a1be33c1df0d50097 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 23:11:40,360 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:40,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:40,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:40,362 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:40,409 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2 2023-07-20 23:11:40,454 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4 2023-07-20 23:11:40,455 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/.tmp/cf/9008a849f9514008bd6cea6168d6cdd5 2023-07-20 23:11:40,462 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/.tmp/cf/9008a849f9514008bd6cea6168d6cdd5 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5 2023-07-20 23:11:40,470 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 23:11:40,479 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1196b05333b5bace8e942838215dbed8 in 122ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:40,479 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 23:11:40,491 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1196b05333b5bace8e942838215dbed8: 2023-07-20 23:11:40,491 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,492 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:40,492 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5] hfiles 2023-07-20 23:11:40,492 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,499 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/.tmp/cf/d8cdbc7d361a480792297454dde25592 2023-07-20 23:11:40,511 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/.tmp/cf/d8cdbc7d361a480792297454dde25592 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592 2023-07-20 23:11:40,522 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592, entries=46, sequenceid=6, filesize=13.3 K 2023-07-20 23:11:40,524 INFO [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 17e5988ab5f1af8a1be33c1df0d50097 in 165ms, sequenceid=6, compaction requested=false 2023-07-20 23:11:40,531 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17e5988ab5f1af8a1be33c1df0d50097: 2023-07-20 23:11:40,532 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,532 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:40,532 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592] hfiles 2023-07-20 23:11:40,532 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,541 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. completed. 2023-07-20 23:11:40,541 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:11:40,541 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:40,541 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:40,541 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,541 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:40,541 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:11:40,543 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,543 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:40,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,543 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:40,544 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,562 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:40,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:11:40,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 23:11:40,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:40,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:40,563 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:11:40,568 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. completed. 2023-07-20 23:11:40,568 DEBUG [rs(jenkins-hbase4.apache.org,44911,1689894621546)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:11:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 23:11:40,568 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:11:40,570 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 23:11:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 23:11:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44911,1689894621546': 2023-07-20 23:11:40,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 23:11:40,576 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 23:11:40,576 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:40,576 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:40,576 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,576 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:40,582 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,581 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,583 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,583 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,584 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,586 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,586 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,587 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,590 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,590 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,590 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:40,590 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,592 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,592 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,592 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:40,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:11:40,592 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:40,592 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:40,593 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:40,593 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,593 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:40,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:40,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2] mob files 2023-07-20 23:11:40,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4 2023-07-20 23:11:40,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2 2023-07-20 23:11:40,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,664 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 23:11:40,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,665 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:11:40,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689894700257Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689894700602 (+345 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689894700602Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689894700602Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689894700606 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689894700619 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689894700664 (+45 ms) 2023-07-20 23:11:40,669 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 23:11:40,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 411 msec 2023-07-20 23:11:40,864 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:40,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 23:11:40,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:40,909 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:40,920 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:40,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:40,925 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:40,940 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:40,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:40,941 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 23:11:40,948 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 23:11:40,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44911] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 23:11:40,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 23:11:40,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:40,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:11:40,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 23:11:40,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:11:40,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:40,966 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:40,967 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:40,967 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f empty. 2023-07-20 23:11:40,967 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b empty. 2023-07-20 23:11:40,968 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:40,968 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:40,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 23:11:41,051 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 23:11:41,053 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 918769e3b8ce3450029ece6c74a0144f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:41,053 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 46ba930b4d9339f3050dfac96d8e230b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:11:41,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:41,086 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:41,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 918769e3b8ce3450029ece6c74a0144f, disabling compactions & flushes 2023-07-20 23:11:41,087 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. after waiting 0 ms 2023-07-20 23:11:41,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,087 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 918769e3b8ce3450029ece6c74a0144f: 2023-07-20 23:11:41,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:41,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 46ba930b4d9339f3050dfac96d8e230b, disabling compactions & flushes 2023-07-20 23:11:41,088 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. after waiting 0 ms 2023-07-20 23:11:41,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,089 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 46ba930b4d9339f3050dfac96d8e230b: 2023-07-20 23:11:41,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:11:41,094 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894701093"}]},"ts":"1689894701093"} 2023-07-20 23:11:41,094 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894701093"}]},"ts":"1689894701093"} 2023-07-20 23:11:41,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:11:41,098 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:11:41,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894701098"}]},"ts":"1689894701098"} 2023-07-20 23:11:41,099 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 23:11:41,104 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:11:41,106 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:11:41,106 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:11:41,106 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:11:41,106 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:11:41,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, ASSIGN}] 2023-07-20 23:11:41,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, ASSIGN 2023-07-20 23:11:41,116 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, ASSIGN 2023-07-20 23:11:41,120 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44911,1689894621546; forceNewPlan=false, retain=false 2023-07-20 23:11:41,120 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:11:41,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:41,270 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:11:41,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=918769e3b8ce3450029ece6c74a0144f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:41,273 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=46ba930b4d9339f3050dfac96d8e230b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:41,274 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894701273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894701273"}]},"ts":"1689894701273"} 2023-07-20 23:11:41,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701273"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894701273"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894701273"}]},"ts":"1689894701273"} 2023-07-20 23:11:41,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 918769e3b8ce3450029ece6c74a0144f, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:41,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 46ba930b4d9339f3050dfac96d8e230b, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:11:41,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 918769e3b8ce3450029ece6c74a0144f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 23:11:41,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. service=AccessControlService 2023-07-20 23:11:41,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:41,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:41,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46ba930b4d9339f3050dfac96d8e230b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 23:11:41,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. service=AccessControlService 2023-07-20 23:11:41,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:41,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:41,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,442 INFO [StoreOpener-46ba930b4d9339f3050dfac96d8e230b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,444 DEBUG [StoreOpener-46ba930b4d9339f3050dfac96d8e230b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf 2023-07-20 23:11:41,444 DEBUG [StoreOpener-46ba930b4d9339f3050dfac96d8e230b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf 2023-07-20 23:11:41,446 INFO [StoreOpener-918769e3b8ce3450029ece6c74a0144f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,447 INFO [StoreOpener-46ba930b4d9339f3050dfac96d8e230b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46ba930b4d9339f3050dfac96d8e230b columnFamilyName cf 2023-07-20 23:11:41,447 INFO [StoreOpener-46ba930b4d9339f3050dfac96d8e230b-1] regionserver.HStore(310): Store=46ba930b4d9339f3050dfac96d8e230b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:41,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,454 DEBUG [StoreOpener-918769e3b8ce3450029ece6c74a0144f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf 2023-07-20 23:11:41,454 DEBUG [StoreOpener-918769e3b8ce3450029ece6c74a0144f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf 2023-07-20 23:11:41,454 INFO [StoreOpener-918769e3b8ce3450029ece6c74a0144f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 918769e3b8ce3450029ece6c74a0144f columnFamilyName cf 2023-07-20 23:11:41,456 INFO [StoreOpener-918769e3b8ce3450029ece6c74a0144f-1] regionserver.HStore(310): Store=918769e3b8ce3450029ece6c74a0144f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:41,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:41,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 46ba930b4d9339f3050dfac96d8e230b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63500850, jitterRate=-0.05376359820365906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:41,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 46ba930b4d9339f3050dfac96d8e230b: 2023-07-20 23:11:41,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b., pid=70, masterSystemTime=1689894701429 2023-07-20 23:11:41,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=46ba930b4d9339f3050dfac96d8e230b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:41,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894701465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894701465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894701465"}]},"ts":"1689894701465"} 2023-07-20 23:11:41,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-20 23:11:41,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 46ba930b4d9339f3050dfac96d8e230b, server=jenkins-hbase4.apache.org,44911,1689894621546 in 190 msec 2023-07-20 23:11:41,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, ASSIGN in 364 msec 2023-07-20 23:11:41,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:11:41,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 918769e3b8ce3450029ece6c74a0144f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65958083, jitterRate=-0.0171479731798172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:41,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 918769e3b8ce3450029ece6c74a0144f: 2023-07-20 23:11:41,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f., pid=69, masterSystemTime=1689894701429 2023-07-20 23:11:41,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=918769e3b8ce3450029ece6c74a0144f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:41,480 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701480"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894701480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894701480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894701480"}]},"ts":"1689894701480"} 2023-07-20 23:11:41,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-20 23:11:41,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 918769e3b8ce3450029ece6c74a0144f, server=jenkins-hbase4.apache.org,35883,1689894621465 in 206 msec 2023-07-20 23:11:41,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-20 23:11:41,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, ASSIGN in 379 msec 2023-07-20 23:11:41,489 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:11:41,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894701489"}]},"ts":"1689894701489"} 2023-07-20 23:11:41,491 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 23:11:41,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:11:41,494 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 23:11:41,497 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 23:11:41,498 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:41,498 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:41,498 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:41,499 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:11:41,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 23:11:41,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 550 msec 2023-07-20 23:11:41,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 23:11:41,564 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 23:11:41,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b], force=true 2023-07-20 23:11:41,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b], force=true 2023-07-20 23:11:41,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b], force=true 2023-07-20 23:11:41,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b], force=true 2023-07-20 23:11:41,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:41,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, UNASSIGN}] 2023-07-20 23:11:41,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, UNASSIGN 2023-07-20 23:11:41,676 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, UNASSIGN 2023-07-20 23:11:41,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=918769e3b8ce3450029ece6c74a0144f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:41,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894701680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894701680"}]},"ts":"1689894701680"} 2023-07-20 23:11:41,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=46ba930b4d9339f3050dfac96d8e230b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:41,680 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894701680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894701680"}]},"ts":"1689894701680"} 2023-07-20 23:11:41,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 918769e3b8ce3450029ece6c74a0144f, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:41,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 46ba930b4d9339f3050dfac96d8e230b, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:11:41,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:41,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 918769e3b8ce3450029ece6c74a0144f, disabling compactions & flushes 2023-07-20 23:11:41,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. after waiting 0 ms 2023-07-20 23:11:41,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 918769e3b8ce3450029ece6c74a0144f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 23:11:41,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 46ba930b4d9339f3050dfac96d8e230b, disabling compactions & flushes 2023-07-20 23:11:41,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. after waiting 0 ms 2023-07-20 23:11:41,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 46ba930b4d9339f3050dfac96d8e230b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 23:11:41,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/.tmp/cf/4923d6d451b0431fad1ba7efbbd85d96 2023-07-20 23:11:41,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/.tmp/cf/0c3b9f39f586475397af121ae6a10ee7 2023-07-20 23:11:41,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/.tmp/cf/0c3b9f39f586475397af121ae6a10ee7 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7 2023-07-20 23:11:41,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/.tmp/cf/4923d6d451b0431fad1ba7efbbd85d96 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96 2023-07-20 23:11:41,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 23:11:41,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 23:11:41,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 46ba930b4d9339f3050dfac96d8e230b in 82ms, sequenceid=5, compaction requested=false 2023-07-20 23:11:41,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 23:11:41,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 918769e3b8ce3450029ece6c74a0144f in 87ms, sequenceid=5, compaction requested=false 2023-07-20 23:11:41,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:41,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 23:11:41,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 23:11:41,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:41,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f. 2023-07-20 23:11:41,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:11:41,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 918769e3b8ce3450029ece6c74a0144f: 2023-07-20 23:11:41,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b. 2023-07-20 23:11:41,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 46ba930b4d9339f3050dfac96d8e230b: 2023-07-20 23:11:41,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:11:41,984 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=918769e3b8ce3450029ece6c74a0144f, regionState=CLOSED 2023-07-20 23:11:41,984 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894701984"}]},"ts":"1689894701984"} 2023-07-20 23:11:41,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:11:41,985 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=46ba930b4d9339f3050dfac96d8e230b, regionState=CLOSED 2023-07-20 23:11:41,985 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689894701985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894701985"}]},"ts":"1689894701985"} 2023-07-20 23:11:41,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-20 23:11:41,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 918769e3b8ce3450029ece6c74a0144f, server=jenkins-hbase4.apache.org,35883,1689894621465 in 303 msec 2023-07-20 23:11:41,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-20 23:11:41,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 46ba930b4d9339f3050dfac96d8e230b, server=jenkins-hbase4.apache.org,44911,1689894621546 in 303 msec 2023-07-20 23:11:41,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=918769e3b8ce3450029ece6c74a0144f, UNASSIGN in 323 msec 2023-07-20 23:11:41,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-20 23:11:41,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=46ba930b4d9339f3050dfac96d8e230b, UNASSIGN in 319 msec 2023-07-20 23:11:42,083 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 23:11:42,088 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700952.918769e3b8ce3450029ece6c74a0144f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:42,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689894700952.46ba930b4d9339f3050dfac96d8e230b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:42,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 23:11:42,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, ASSIGN}] 2023-07-20 23:11:42,162 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, ASSIGN 2023-07-20 23:11:42,166 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:11:42,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:42,317 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 23:11:42,319 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ceda96d8cc463c4f593692c939c51255, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:42,319 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894702319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894702319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894702319"}]},"ts":"1689894702319"} 2023-07-20 23:11:42,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ceda96d8cc463c4f593692c939c51255, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:11:42,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:11:42,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ceda96d8cc463c4f593692c939c51255, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.', STARTKEY => '', ENDKEY => ''} 2023-07-20 23:11:42,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. service=AccessControlService 2023-07-20 23:11:42,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:11:42,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:42,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:11:42,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:42,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:42,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/.regioninfo 2023-07-20 23:11:42,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:42,918 INFO [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:42,919 DEBUG [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf 2023-07-20 23:11:42,919 DEBUG [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf 2023-07-20 23:11:42,919 INFO [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ceda96d8cc463c4f593692c939c51255 columnFamilyName cf 2023-07-20 23:11:42,977 DEBUG [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] regionserver.HStore(539): loaded hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/0c3b9f39f586475397af121ae6a10ee7.918769e3b8ce3450029ece6c74a0144f->hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7-top 2023-07-20 23:11:42,986 DEBUG [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] regionserver.HStore(539): loaded hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/4923d6d451b0431fad1ba7efbbd85d96.46ba930b4d9339f3050dfac96d8e230b->hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96-top 2023-07-20 23:11:42,987 INFO [StoreOpener-ceda96d8cc463c4f593692c939c51255-1] regionserver.HStore(310): Store=ceda96d8cc463c4f593692c939c51255/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:11:42,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:42,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:43,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ceda96d8cc463c4f593692c939c51255 2023-07-20 23:11:43,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ceda96d8cc463c4f593692c939c51255; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75029659, jitterRate=0.11802904307842255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:11:43,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ceda96d8cc463c4f593692c939c51255: 2023-07-20 23:11:43,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255., pid=77, masterSystemTime=1689894702477 2023-07-20 23:11:43,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.,because compaction is disabled. 2023-07-20 23:11:43,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:11:43,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:11:43,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ceda96d8cc463c4f593692c939c51255, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894703008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894703008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894703008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894703008"}]},"ts":"1689894703008"} 2023-07-20 23:11:43,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 23:11:43,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ceda96d8cc463c4f593692c939c51255, server=jenkins-hbase4.apache.org,35883,1689894621465 in 690 msec 2023-07-20 23:11:43,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 23:11:43,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, ASSIGN in 854 msec 2023-07-20 23:11:43,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[918769e3b8ce3450029ece6c74a0144f, 46ba930b4d9339f3050dfac96d8e230b], force=true in 1.4000 sec 2023-07-20 23:11:43,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0004_000001 (auth:SIMPLE) 2023-07-20 23:11:43,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 23:11:43,776 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 23:11:43,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:43,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894703778 (current time:1689894703778). 2023-07-20 23:11:43,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:11:43,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x7c8d4c56 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:43,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ae68c39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:43,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:43,815 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:43,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c8d4c56 to 127.0.0.1:62235 2023-07-20 23:11:43,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:43,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x6e2a1b5e to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:11:43,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78d31531, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:11:43,847 DEBUG [hconnection-0x66cac956-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:11:43,849 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:11:43,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e2a1b5e to 127.0.0.1:62235 2023-07-20 23:11:43,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:11:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 23:11:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:11:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:43,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:43,859 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:43,859 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689895303859 2023-07-20 23:11:43,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 23:11:43,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,863 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:11:43,863 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:11:43,864 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 23:11:43,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:43,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-07-20 23:11:43,866 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:43,867 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689895303867 2023-07-20 23:11:43,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,883 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 23:11:43,884 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:43,885 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 23:11:43,885 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 23:11:43,886 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,886 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,887 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:43,887 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:43,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:43,887 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:43,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:43,888 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,888 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,888 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:43,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:43,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:43,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:43,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:43,892 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:43,893 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:43,893 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:43,893 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 23:11:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,893 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 23:11:43,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,894 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 23:11:43,894 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:11:43,895 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 23:11:43,895 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 23:11:43,895 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 23:11:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:43,902 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:43,903 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,903 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:11:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:43,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 23:11:43,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d42f44e[Count = 0] remaining members to acquire global barrier 2023-07-20 23:11:43,906 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 23:11:43,906 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,908 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:11:43,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:43,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,909 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 23:11:43,909 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:11:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:11:43,909 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:11:43,910 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. started... 2023-07-20 23:11:43,912 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ceda96d8cc463c4f593692c939c51255: 2023-07-20 23:11:43,912 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,912 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:11:43,912 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/0c3b9f39f586475397af121ae6a10ee7.918769e3b8ce3450029ece6c74a0144f->hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7-top, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/4923d6d451b0431fad1ba7efbbd85d96.46ba930b4d9339f3050dfac96d8e230b->hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96-top] hfiles 2023-07-20 23:11:43,912 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/0c3b9f39f586475397af121ae6a10ee7.918769e3b8ce3450029ece6c74a0144f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:43,917 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/4923d6d451b0431fad1ba7efbbd85d96.46ba930b4d9339f3050dfac96d8e230b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:43,963 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:43,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 23:11:43,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:11:43,966 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:11:43,978 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. completed. 2023-07-20 23:11:43,978 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:11:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:11:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:11:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 23:11:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:11:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 23:11:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 23:11:43,986 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:43,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:43,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:43,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:43,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:43,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:11:43,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 23:11:43,991 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 23:11:43,991 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:11:43,991 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:11:43,992 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,992 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:43,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:11:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:11:43,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:43,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,994 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:43,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:43,995 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,003 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:11:44,004 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:11:44,008 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,008 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:44,009 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:11:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,014 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:11:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,015 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:11:44,015 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,015 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:44,015 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,015 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:11:44,018 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,018 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:11:44,019 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:11:44,019 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,019 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,019 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:11:44,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 23:11:44,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,114 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689894703860Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704019 (+159 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704019Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704033 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689894704051 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689894704114 (+63 ms) 2023-07-20 23:11:44,117 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 23:11:44,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 254 msec 2023-07-20 23:11:44,167 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:11:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 23:11:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:11:44,168 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168 2023-07-20 23:11:44,168 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33859, tgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168, rawTgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:44,190 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:11:44,190 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_948920886_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,191 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 23:11:44,201 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:11:44,241 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,242 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,242 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,243 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,243 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,243 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,244 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,319 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-7728656802656938337.jar 2023-07-20 23:11:44,320 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,320 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,321 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,321 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,321 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,322 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:11:44,322 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:11:44,323 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:11:44,323 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:11:44,324 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:11:44,324 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:11:44,324 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:11:44,325 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:11:44,325 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:11:44,325 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:11:44,326 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:11:44,326 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,327 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,327 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:44,327 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,328 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:11:44,328 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:44,328 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:11:44,346 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:11:45,587 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:11:45,590 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 23:11:45,595 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 23:11:45,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:45,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:11:46,373 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:52,742 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:55,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0005_000001 (auth:SIMPLE) 2023-07-20 23:11:59,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0005_000001 (auth:SIMPLE) 2023-07-20 23:12:01,071 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:01,081 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:01,099 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,099 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:01,100 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:01,100 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 23:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 23:12:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 23:12:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894704168/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 23:12:01,130 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:01,138 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721138"}]},"ts":"1689894721138"} 2023-07-20 23:12:01,142 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 23:12:01,145 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 23:12:01,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, UNASSIGN}] 2023-07-20 23:12:01,148 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, UNASSIGN 2023-07-20 23:12:01,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ceda96d8cc463c4f593692c939c51255, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:01,150 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894721149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894721149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894721149"}]},"ts":"1689894721149"} 2023-07-20 23:12:01,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ceda96d8cc463c4f593692c939c51255, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:01,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:01,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ceda96d8cc463c4f593692c939c51255 2023-07-20 23:12:01,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ceda96d8cc463c4f593692c939c51255, disabling compactions & flushes 2023-07-20 23:12:01,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:12:01,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:12:01,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. after waiting 0 ms 2023-07-20 23:12:01,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:12:01,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 23:12:01,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:01,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255. 2023-07-20 23:12:01,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ceda96d8cc463c4f593692c939c51255: 2023-07-20 23:12:01,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ceda96d8cc463c4f593692c939c51255 2023-07-20 23:12:01,322 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ceda96d8cc463c4f593692c939c51255, regionState=CLOSED 2023-07-20 23:12:01,323 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689894721322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894721322"}]},"ts":"1689894721322"} 2023-07-20 23:12:01,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 23:12:01,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ceda96d8cc463c4f593692c939c51255, server=jenkins-hbase4.apache.org,35883,1689894621465 in 170 msec 2023-07-20 23:12:01,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 23:12:01,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ceda96d8cc463c4f593692c939c51255, UNASSIGN in 181 msec 2023-07-20 23:12:01,328 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721328"}]},"ts":"1689894721328"} 2023-07-20 23:12:01,335 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 23:12:01,337 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 23:12:01,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 208 msec 2023-07-20 23:12:01,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 23:12:01,440 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 23:12:01,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,450 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,451 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,452 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,454 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,454 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:01,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:01,456 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,456 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:01,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 23:12:01,459 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,459 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,460 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:01,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 23:12:01,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:01,463 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255 2023-07-20 23:12:01,463 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:12:01,463 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:12:01,465 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/recovered.edits] 2023-07-20 23:12:01,466 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/recovered.edits] 2023-07-20 23:12:01,466 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/recovered.edits] 2023-07-20 23:12:01,479 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/0c3b9f39f586475397af121ae6a10ee7.918769e3b8ce3450029ece6c74a0144f to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/0c3b9f39f586475397af121ae6a10ee7.918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:12:01,480 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/cf/4923d6d451b0431fad1ba7efbbd85d96 2023-07-20 23:12:01,486 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/cf/0c3b9f39f586475397af121ae6a10ee7 2023-07-20 23:12:01,490 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/recovered.edits/8.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b/recovered.edits/8.seqid 2023-07-20 23:12:01,491 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:12:01,494 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/recovered.edits/8.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f/recovered.edits/8.seqid 2023-07-20 23:12:01,495 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/918769e3b8ce3450029ece6c74a0144f 2023-07-20 23:12:01,496 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/4923d6d451b0431fad1ba7efbbd85d96.46ba930b4d9339f3050dfac96d8e230b to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/cf/4923d6d451b0431fad1ba7efbbd85d96.46ba930b4d9339f3050dfac96d8e230b 2023-07-20 23:12:01,500 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/recovered.edits/12.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255/recovered.edits/12.seqid 2023-07-20 23:12:01,500 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ceda96d8cc463c4f593692c939c51255 2023-07-20 23:12:01,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 23:12:01,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,506 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 23:12:01,507 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 23:12:01,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 23:12:01,509 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894721509"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:01,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 23:12:01,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ceda96d8cc463c4f593692c939c51255, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689894700953.ceda96d8cc463c4f593692c939c51255.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 23:12:01,512 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 23:12:01,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894721512"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:01,514 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 23:12:01,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:01,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 75 msec 2023-07-20 23:12:01,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 23:12:01,563 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 23:12:01,564 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:01,574 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721571"}]},"ts":"1689894721571"} 2023-07-20 23:12:01,576 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 23:12:01,577 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 23:12:01,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, UNASSIGN}] 2023-07-20 23:12:01,579 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, UNASSIGN 2023-07-20 23:12:01,580 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, UNASSIGN 2023-07-20 23:12:01,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=17e5988ab5f1af8a1be33c1df0d50097, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:01,589 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1196b05333b5bace8e942838215dbed8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:01,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894721588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894721588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894721588"}]},"ts":"1689894721588"} 2023-07-20 23:12:01,589 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894721589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894721589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894721589"}]},"ts":"1689894721589"} 2023-07-20 23:12:01,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 17e5988ab5f1af8a1be33c1df0d50097, server=jenkins-hbase4.apache.org,44911,1689894621546}] 2023-07-20 23:12:01,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 1196b05333b5bace8e942838215dbed8, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:01,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:01,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:12:01,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17e5988ab5f1af8a1be33c1df0d50097, disabling compactions & flushes 2023-07-20 23:12:01,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:12:01,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:12:01,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. after waiting 0 ms 2023-07-20 23:12:01,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:12:01,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1196b05333b5bace8e942838215dbed8 2023-07-20 23:12:01,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1196b05333b5bace8e942838215dbed8, disabling compactions & flushes 2023-07-20 23:12:01,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:12:01,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:12:01,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. after waiting 0 ms 2023-07-20 23:12:01,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:12:01,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:01,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:01,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097. 2023-07-20 23:12:01,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:01,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17e5988ab5f1af8a1be33c1df0d50097: 2023-07-20 23:12:01,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:12:01,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:01,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8. 2023-07-20 23:12:01,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=17e5988ab5f1af8a1be33c1df0d50097, regionState=CLOSED 2023-07-20 23:12:01,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1196b05333b5bace8e942838215dbed8: 2023-07-20 23:12:01,763 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894721762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894721762"}]},"ts":"1689894721762"} 2023-07-20 23:12:01,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1196b05333b5bace8e942838215dbed8 2023-07-20 23:12:01,766 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1196b05333b5bace8e942838215dbed8, regionState=CLOSED 2023-07-20 23:12:01,766 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689894721766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894721766"}]},"ts":"1689894721766"} 2023-07-20 23:12:01,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-20 23:12:01,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 17e5988ab5f1af8a1be33c1df0d50097, server=jenkins-hbase4.apache.org,44911,1689894621546 in 175 msec 2023-07-20 23:12:01,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-20 23:12:01,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 1196b05333b5bace8e942838215dbed8, server=jenkins-hbase4.apache.org,35883,1689894621465 in 178 msec 2023-07-20 23:12:01,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17e5988ab5f1af8a1be33c1df0d50097, UNASSIGN in 194 msec 2023-07-20 23:12:01,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-20 23:12:01,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1196b05333b5bace8e942838215dbed8, UNASSIGN in 195 msec 2023-07-20 23:12:01,776 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894721776"}]},"ts":"1689894721776"} 2023-07-20 23:12:01,778 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 23:12:01,838 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 23:12:01,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 298 msec 2023-07-20 23:12:01,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 23:12:01,874 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 23:12:01,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,877 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,878 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,880 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,883 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:12:01,883 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:12:01,885 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/recovered.edits] 2023-07-20 23:12:01,885 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/recovered.edits] 2023-07-20 23:12:01,889 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/cf/9008a849f9514008bd6cea6168d6cdd5 2023-07-20 23:12:01,889 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/cf/d8cdbc7d361a480792297454dde25592 2023-07-20 23:12:01,893 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8/recovered.edits/9.seqid 2023-07-20 23:12:01,893 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097/recovered.edits/9.seqid 2023-07-20 23:12:01,893 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1196b05333b5bace8e942838215dbed8 2023-07-20 23:12:01,894 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17e5988ab5f1af8a1be33c1df0d50097 2023-07-20 23:12:01,894 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 23:12:01,895 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 23:12:01,896 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-20 23:12:01,901 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720eea77c9f8516433284b424bfe5a15ec4 2023-07-20 23:12:01,906 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307203229ad9e1d154146a4a3d8292d424dc2 2023-07-20 23:12:01,907 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 23:12:01,909 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,912 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 23:12:01,991 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,991 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,991 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:01,991 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:01,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:01,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 23:12:01,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,007 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,007 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 23:12:02,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 23:12:02,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 23:12:02,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894722039"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:02,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894722039"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:02,041 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:02,041 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1196b05333b5bace8e942838215dbed8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689894699017.1196b05333b5bace8e942838215dbed8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17e5988ab5f1af8a1be33c1df0d50097, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689894699017.17e5988ab5f1af8a1be33c1df0d50097.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:02,042 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 23:12:02,042 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894722042"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:02,044 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 23:12:02,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 217 msec 2023-07-20 23:12:02,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 23:12:02,109 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 23:12:02,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 23:12:02,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 23:12:02,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 23:12:02,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 23:12:02,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 23:12:02,185 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:49594 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:36948 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:44429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1185751278_1 at /127.0.0.1:55572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4220 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1185751278_1 at /127.0.0.1:37832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:38714 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:36936 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=589 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1360 (was 1565) 2023-07-20 23:12:02,185 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 23:12:02,213 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=589, ProcessCount=183, AvailableMemoryMB=1353 2023-07-20 23:12:02,214 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 23:12:02,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:12:02,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:02,220 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:12:02,221 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 23:12:02,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:12:02,225 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,225 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,226 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc empty. 2023-07-20 23:12:02,226 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,226 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a empty. 2023-07-20 23:12:02,227 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,227 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 23:12:02,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:02,257 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 23:12:02,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f1f317eb3342f0346ed193ff156c5bdc, NAME => 'testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:12:02,259 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f151dea6f41f1f510fb41daab09b644a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f1f317eb3342f0346ed193ff156c5bdc, disabling compactions & flushes 2023-07-20 23:12:02,298 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. after waiting 0 ms 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,298 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f1f317eb3342f0346ed193ff156c5bdc: 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f151dea6f41f1f510fb41daab09b644a, disabling compactions & flushes 2023-07-20 23:12:02,299 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. after waiting 0 ms 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,299 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,299 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f151dea6f41f1f510fb41daab09b644a: 2023-07-20 23:12:02,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:12:02,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894722313"}]},"ts":"1689894722313"} 2023-07-20 23:12:02,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894722313"}]},"ts":"1689894722313"} 2023-07-20 23:12:02,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:12:02,317 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:12:02,317 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894722317"}]},"ts":"1689894722317"} 2023-07-20 23:12:02,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 23:12:02,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:02,407 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:12:02,409 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:12:02,409 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:12:02,409 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:12:02,409 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:12:02,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, ASSIGN}] 2023-07-20 23:12:02,412 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, ASSIGN 2023-07-20 23:12:02,412 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, ASSIGN 2023-07-20 23:12:02,413 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:12:02,413 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:12:02,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:02,563 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:12:02,567 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f151dea6f41f1f510fb41daab09b644a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,567 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894722567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894722567"}]},"ts":"1689894722567"} 2023-07-20 23:12:02,567 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f1f317eb3342f0346ed193ff156c5bdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,568 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894722567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894722567"}]},"ts":"1689894722567"} 2023-07-20 23:12:02,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f151dea6f41f1f510fb41daab09b644a, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:02,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure f1f317eb3342f0346ed193ff156c5bdc, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:12:02,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f151dea6f41f1f510fb41daab09b644a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:12:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. service=AccessControlService 2023-07-20 23:12:02,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:02,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:02,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,731 INFO [StoreOpener-f151dea6f41f1f510fb41daab09b644a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,734 DEBUG [StoreOpener-f151dea6f41f1f510fb41daab09b644a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf 2023-07-20 23:12:02,734 DEBUG [StoreOpener-f151dea6f41f1f510fb41daab09b644a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf 2023-07-20 23:12:02,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1f317eb3342f0346ed193ff156c5bdc, NAME => 'testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:12:02,735 INFO [StoreOpener-f151dea6f41f1f510fb41daab09b644a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f151dea6f41f1f510fb41daab09b644a columnFamilyName cf 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. service=AccessControlService 2023-07-20 23:12:02,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,736 INFO [StoreOpener-f151dea6f41f1f510fb41daab09b644a-1] regionserver.HStore(310): Store=f151dea6f41f1f510fb41daab09b644a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:02,737 INFO [StoreOpener-f1f317eb3342f0346ed193ff156c5bdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,739 DEBUG [StoreOpener-f1f317eb3342f0346ed193ff156c5bdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf 2023-07-20 23:12:02,739 DEBUG [StoreOpener-f1f317eb3342f0346ed193ff156c5bdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf 2023-07-20 23:12:02,739 INFO [StoreOpener-f1f317eb3342f0346ed193ff156c5bdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1f317eb3342f0346ed193ff156c5bdc columnFamilyName cf 2023-07-20 23:12:02,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,741 INFO [StoreOpener-f1f317eb3342f0346ed193ff156c5bdc-1] regionserver.HStore(310): Store=f1f317eb3342f0346ed193ff156c5bdc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:02,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:02,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:02,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:02,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:02,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f151dea6f41f1f510fb41daab09b644a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67129297, jitterRate=3.0447542667388916E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:02,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f151dea6f41f1f510fb41daab09b644a: 2023-07-20 23:12:02,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1f317eb3342f0346ed193ff156c5bdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63897054, jitterRate=-0.04785969853401184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:02,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1f317eb3342f0346ed193ff156c5bdc: 2023-07-20 23:12:02,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a., pid=93, masterSystemTime=1689894722725 2023-07-20 23:12:02,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc., pid=94, masterSystemTime=1689894722727 2023-07-20 23:12:02,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f151dea6f41f1f510fb41daab09b644a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894722752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894722752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894722752"}]},"ts":"1689894722752"} 2023-07-20 23:12:02,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,752 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f1f317eb3342f0346ed193ff156c5bdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,753 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894722752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894722752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894722752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894722752"}]},"ts":"1689894722752"} 2023-07-20 23:12:02,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 23:12:02,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f151dea6f41f1f510fb41daab09b644a, server=jenkins-hbase4.apache.org,35883,1689894621465 in 183 msec 2023-07-20 23:12:02,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 23:12:02,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure f1f317eb3342f0346ed193ff156c5bdc, server=jenkins-hbase4.apache.org,33297,1689894621380 in 181 msec 2023-07-20 23:12:02,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, ASSIGN in 366 msec 2023-07-20 23:12:02,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-20 23:12:02,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, ASSIGN in 366 msec 2023-07-20 23:12:02,780 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:12:02,780 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894722780"}]},"ts":"1689894722780"} 2023-07-20 23:12:02,782 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 23:12:02,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:12:02,785 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 23:12:02,787 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:02,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:02,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:02,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:02,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:02,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:02,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 575 msec 2023-07-20 23:12:02,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 23:12:02,832 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 23:12:02,834 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:02,834 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,836 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:02,853 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:02,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894722853 (current time:1689894722853). 2023-07-20 23:12:02,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:02,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x1b947dd3 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:02,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bc2339f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:02,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:02,870 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b947dd3 to 127.0.0.1:62235 2023-07-20 23:12:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x43f915d5 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:02,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bbb829c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:02,885 DEBUG [hconnection-0x514f18bf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:02,887 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:02,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43f915d5 to 127.0.0.1:62235 2023-07-20 23:12:02,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:02,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:02,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:02,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,900 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,901 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895322901 2023-07-20 23:12:02,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:02,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:02,903 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:02,903 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:02,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:02,905 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:02,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-20 23:12:02,910 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:02,911 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895322911 2023-07-20 23:12:02,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,926 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 23:12:02,926 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,928 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 23:12:02,928 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:12:02,928 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,928 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,934 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,935 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,937 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:02,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:02,938 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,939 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,939 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,939 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,940 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:02,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,950 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,950 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,950 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,950 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,950 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:02,958 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:02,952 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,959 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,959 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,961 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,961 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,961 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,961 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,964 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,966 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,968 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2746c82f[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:02,970 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:02,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:02,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2746c82f[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:02,971 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:12:02,972 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:02,975 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:02,976 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:02,976 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:02,975 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:12:02,977 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:02,977 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:02,977 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:02,978 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:02,980 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:02,980 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. started... 2023-07-20 23:12:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:02,983 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:02,983 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f151dea6f41f1f510fb41daab09b644a: 2023-07-20 23:12:02,983 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. started... 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1f317eb3342f0346ed193ff156c5bdc: 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:02,984 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:03,004 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:03,005 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:03,035 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. completed. 2023-07-20 23:12:03,035 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:03,035 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:03,035 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:03,035 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,035 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:03,035 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:12:03,037 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:03,037 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,037 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,037 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:12:03,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:12:03,205 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:03,207 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:03,436 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. completed. 2023-07-20 23:12:03,436 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:03,436 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:03,437 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:03,437 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,437 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:03,437 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:12:03,439 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,439 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,439 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,439 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:12:03,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:12:03,447 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 23:12:03,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:03,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:03,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,447 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:03,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:03,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,450 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,451 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:03,451 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,451 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,452 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:03,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,454 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,455 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,455 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,463 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:03,463 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:03,462 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:03,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:03,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:03,465 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:03,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:12:03,466 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,466 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:12:03,507 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:03,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:03,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:03,509 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 23:12:03,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 23:12:03,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,692 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:03,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689894722901Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689894723557 (+656 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689894723557Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689894723557Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689894723584 (+27 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689894723610 (+26 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689894723691 (+81 ms) 2023-07-20 23:12:03,695 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:03,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 792 msec 2023-07-20 23:12:04,009 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:04,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:04,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:04,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:04,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:04,018 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:04,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:04,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894724029 (current time:1689894724029). 2023-07-20 23:12:04,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:04,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x7ff59d86 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:04,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56d6e827, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:04,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:04,041 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:04,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ff59d86 to 127.0.0.1:62235 2023-07-20 23:12:04,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x3ae63f6f to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:04,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ac8c18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:04,052 DEBUG [hconnection-0x8dac6da-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:04,054 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ae63f6f to 127.0.0.1:62235 2023-07-20 23:12:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 23:12:04,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:04,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:04,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:04,067 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:04,068 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689895324068 2023-07-20 23:12:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 23:12:04,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:04,071 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:04,071 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:04,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:04,072 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 23:12:04,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-20 23:12:04,076 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:04,076 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689895324076 2023-07-20 23:12:04,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,085 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 23:12:04,085 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:04,086 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 23:12:04,087 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 23:12:04,089 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,089 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,091 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,091 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,092 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,092 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,092 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,093 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,093 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,093 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 23:12:04,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:04,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 23:12:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 23:12:04,104 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:04,104 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:04,104 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 23:12:04,104 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 23:12:04,105 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,105 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:04,106 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,106 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:04,106 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:04,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a4b41b[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,111 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:04,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 23:12:04,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a4b41b[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:04,114 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 23:12:04,114 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:04,119 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:04,119 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:12:04,119 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. started... 2023-07-20 23:12:04,119 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,120 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 23:12:04,120 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:04,121 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:04,121 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:04,121 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. started... 2023-07-20 23:12:04,121 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f151dea6f41f1f510fb41daab09b644a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 23:12:04,121 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,121 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1f317eb3342f0346ed193ff156c5bdc 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 23:12:04,121 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:04,122 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:04,122 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:04,122 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:04,171 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:04,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:04,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:04,173 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:04,201 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6 2023-07-20 23:12:04,202 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778 2023-07-20 23:12:04,243 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/.tmp/cf/aba2536f279843dbab432bd00c0b2989 2023-07-20 23:12:04,244 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/.tmp/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 2023-07-20 23:12:04,253 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/.tmp/cf/aba2536f279843dbab432bd00c0b2989 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989 2023-07-20 23:12:04,253 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/.tmp/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 2023-07-20 23:12:04,260 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989, entries=45, sequenceid=6, filesize=12.7 K 2023-07-20 23:12:04,261 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f151dea6f41f1f510fb41daab09b644a in 140ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:04,261 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 23:12:04,273 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f151dea6f41f1f510fb41daab09b644a: 2023-07-20 23:12:04,273 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,281 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:04,281 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989] hfiles 2023-07-20 23:12:04,281 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,282 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1, entries=5, sequenceid=6, filesize=5.8 K 2023-07-20 23:12:04,287 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f1f317eb3342f0346ed193ff156c5bdc in 166ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1f317eb3342f0346ed193ff156c5bdc: 2023-07-20 23:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1] hfiles 2023-07-20 23:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,325 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. completed. 2023-07-20 23:12:04,325 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,325 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. completed. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:12:04,325 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:04,326 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,326 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 23:12:04,326 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:12:04,327 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,327 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:04,327 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:04,327 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:04,330 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,330 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:04,330 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:04,330 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 23:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:04,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:04,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:04,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:04,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:12:04,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 23:12:04,342 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 23:12:04,342 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:04,342 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:04,342 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,342 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:04,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,346 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:04,347 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,354 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:04,355 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,358 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,359 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,359 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,368 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,369 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:04,369 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:04,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778] mob files 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:04,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:04,372 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,373 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,373 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:04,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:04,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:04,375 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:04,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:04,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:04,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 23:12:04,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,500 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689894724068Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689894724402 (+334 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689894724402Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689894724402Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689894724406 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689894724439 (+33 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689894724499 (+60 ms) 2023-07-20 23:12:04,504 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 23:12:04,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 433 msec 2023-07-20 23:12:04,675 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:04,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 23:12:04,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:04,682 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682 2023-07-20 23:12:04,682 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33859, tgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682, rawTgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:12:04,708 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:12:04,708 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1882642933_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,708 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 23:12:04,733 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:04,785 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,785 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,786 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,787 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,787 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,788 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,788 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,876 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-8214996801566367755.jar 2023-07-20 23:12:04,877 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,877 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,877 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,878 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,878 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,878 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:04,879 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:12:04,879 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:12:04,879 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:12:04,880 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:12:04,880 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:12:04,880 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:12:04,881 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:12:04,881 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:12:04,881 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:12:04,882 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:12:04,883 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,883 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,884 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:04,884 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,884 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:04,885 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:04,886 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:05,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0005_000001 (auth:SIMPLE) 2023-07-20 23:12:05,952 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:12:05,955 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 23:12:06,147 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:06,147 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:06,256 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:06,943 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:12,751 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:15,470 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:15,471 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:15,478 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,479 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:15,479 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:15,479 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 23:12:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 23:12:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,481 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 23:12:15,481 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894724682/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 23:12:15,486 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894735493"}]},"ts":"1689894735493"} 2023-07-20 23:12:15,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,497 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 23:12:15,501 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 23:12:15,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, UNASSIGN}] 2023-07-20 23:12:15,503 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, UNASSIGN 2023-07-20 23:12:15,505 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, UNASSIGN 2023-07-20 23:12:15,506 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f151dea6f41f1f510fb41daab09b644a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:15,506 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f1f317eb3342f0346ed193ff156c5bdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:15,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894735506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894735506"}]},"ts":"1689894735506"} 2023-07-20 23:12:15,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735506"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894735506"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894735506"}]},"ts":"1689894735506"} 2023-07-20 23:12:15,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f151dea6f41f1f510fb41daab09b644a, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:15,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure f1f317eb3342f0346ed193ff156c5bdc, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:12:15,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:15,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f151dea6f41f1f510fb41daab09b644a, disabling compactions & flushes 2023-07-20 23:12:15,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:15,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:15,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. after waiting 0 ms 2023-07-20 23:12:15,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:15,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:15,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1f317eb3342f0346ed193ff156c5bdc, disabling compactions & flushes 2023-07-20 23:12:15,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:15,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:15,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. after waiting 0 ms 2023-07-20 23:12:15,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:15,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:15,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:15,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc. 2023-07-20 23:12:15,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1f317eb3342f0346ed193ff156c5bdc: 2023-07-20 23:12:15,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:15,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:15,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a. 2023-07-20 23:12:15,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f151dea6f41f1f510fb41daab09b644a: 2023-07-20 23:12:15,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:15,722 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f1f317eb3342f0346ed193ff156c5bdc, regionState=CLOSED 2023-07-20 23:12:15,722 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894735722"}]},"ts":"1689894735722"} 2023-07-20 23:12:15,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:15,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f151dea6f41f1f510fb41daab09b644a, regionState=CLOSED 2023-07-20 23:12:15,731 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689894735731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894735731"}]},"ts":"1689894735731"} 2023-07-20 23:12:15,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-20 23:12:15,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure f1f317eb3342f0346ed193ff156c5bdc, server=jenkins-hbase4.apache.org,33297,1689894621380 in 210 msec 2023-07-20 23:12:15,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f1f317eb3342f0346ed193ff156c5bdc, UNASSIGN in 234 msec 2023-07-20 23:12:15,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-20 23:12:15,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f151dea6f41f1f510fb41daab09b644a, server=jenkins-hbase4.apache.org,35883,1689894621465 in 226 msec 2023-07-20 23:12:15,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 23:12:15,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f151dea6f41f1f510fb41daab09b644a, UNASSIGN in 238 msec 2023-07-20 23:12:15,746 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894735745"}]},"ts":"1689894735745"} 2023-07-20 23:12:15,748 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 23:12:15,750 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 23:12:15,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 265 msec 2023-07-20 23:12:15,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 23:12:15,798 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 23:12:15,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,804 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,805 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,806 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,810 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,810 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,810 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,810 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,812 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,813 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,813 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:15,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 23:12:15,814 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:15,817 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/recovered.edits] 2023-07-20 23:12:15,817 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:15,824 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/recovered.edits] 2023-07-20 23:12:15,825 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/cf/aba2536f279843dbab432bd00c0b2989 2023-07-20 23:12:15,831 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a/recovered.edits/9.seqid 2023-07-20 23:12:15,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f151dea6f41f1f510fb41daab09b644a 2023-07-20 23:12:15,832 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/cf/1cff6c2a0ad6489ca3e9eaf107b019a1 2023-07-20 23:12:15,837 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc/recovered.edits/9.seqid 2023-07-20 23:12:15,838 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testEmptyExportFileSystemState/f1f317eb3342f0346ed193ff156c5bdc 2023-07-20 23:12:15,838 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 23:12:15,839 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 23:12:15,840 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-20 23:12:15,848 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720f76832bf074b4cc0a1122b71e36f04c6 2023-07-20 23:12:15,851 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307205240412d93844004a0eb256d8d57d778 2023-07-20 23:12:15,852 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 23:12:15,856 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,860 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 23:12:15,863 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 23:12:15,864 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,864 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 23:12:15,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894735864"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894735864"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,876 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:15,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f1f317eb3342f0346ed193ff156c5bdc, NAME => 'testtb-testEmptyExportFileSystemState,,1689894722215.f1f317eb3342f0346ed193ff156c5bdc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f151dea6f41f1f510fb41daab09b644a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689894722215.f151dea6f41f1f510fb41daab09b644a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:15,876 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 23:12:15,877 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894735876"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:15,887 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 23:12:15,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 23:12:15,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 92 msec 2023-07-20 23:12:15,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 23:12:15,915 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 23:12:15,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 23:12:15,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,932 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 23:12:15,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 23:12:15,972 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758 (was 758), OpenFileDescriptor=921 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=662 (was 589) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=264 (was 1353) 2023-07-20 23:12:15,972 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 23:12:16,009 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=758, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=662, ProcessCount=183, AvailableMemoryMB=263 2023-07-20 23:12:16,009 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-20 23:12:16,011 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 23:12:16,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 23:12:16,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 23:12:16,016 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 23:12:16,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,019 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,019 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,020 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 empty. 2023-07-20 23:12:16,020 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 empty. 2023-07-20 23:12:16,020 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,020 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,020 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 23:12:16,042 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 23:12:16,043 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6140f6e3a6032e7d150b8a82b7f59832, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:12:16,043 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c00ded12cf919d939a1b64d337e2887, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp 2023-07-20 23:12:16,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6140f6e3a6032e7d150b8a82b7f59832, disabling compactions & flushes 2023-07-20 23:12:16,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. after waiting 0 ms 2023-07-20 23:12:16,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,072 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6140f6e3a6032e7d150b8a82b7f59832: 2023-07-20 23:12:16,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 9c00ded12cf919d939a1b64d337e2887, disabling compactions & flushes 2023-07-20 23:12:16,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. after waiting 0 ms 2023-07-20 23:12:16,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 9c00ded12cf919d939a1b64d337e2887: 2023-07-20 23:12:16,089 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 23:12:16,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894736090"}]},"ts":"1689894736090"} 2023-07-20 23:12:16,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894736090"}]},"ts":"1689894736090"} 2023-07-20 23:12:16,115 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 23:12:16,116 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 23:12:16,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894736116"}]},"ts":"1689894736116"} 2023-07-20 23:12:16,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,118 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 23:12:16,122 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 23:12:16,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 23:12:16,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 23:12:16,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 23:12:16,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 23:12:16,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, ASSIGN}] 2023-07-20 23:12:16,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, ASSIGN 2023-07-20 23:12:16,129 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, ASSIGN 2023-07-20 23:12:16,130 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33297,1689894621380; forceNewPlan=false, retain=false 2023-07-20 23:12:16,132 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35883,1689894621465; forceNewPlan=false, retain=false 2023-07-20 23:12:16,281 INFO [jenkins-hbase4:42665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 23:12:16,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6140f6e3a6032e7d150b8a82b7f59832, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c00ded12cf919d939a1b64d337e2887, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894736284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894736284"}]},"ts":"1689894736284"} 2023-07-20 23:12:16,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894736284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894736284"}]},"ts":"1689894736284"} 2023-07-20 23:12:16,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 6140f6e3a6032e7d150b8a82b7f59832, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:12:16,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 9c00ded12cf919d939a1b64d337e2887, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c00ded12cf919d939a1b64d337e2887, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 23:12:16,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. service=AccessControlService 2023-07-20 23:12:16,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6140f6e3a6032e7d150b8a82b7f59832, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 23:12:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. service=AccessControlService 2023-07-20 23:12:16,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 23:12:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 23:12:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,447 INFO [StoreOpener-6140f6e3a6032e7d150b8a82b7f59832-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,447 INFO [StoreOpener-9c00ded12cf919d939a1b64d337e2887-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,449 DEBUG [StoreOpener-6140f6e3a6032e7d150b8a82b7f59832-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf 2023-07-20 23:12:16,449 DEBUG [StoreOpener-6140f6e3a6032e7d150b8a82b7f59832-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf 2023-07-20 23:12:16,450 DEBUG [StoreOpener-9c00ded12cf919d939a1b64d337e2887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf 2023-07-20 23:12:16,450 DEBUG [StoreOpener-9c00ded12cf919d939a1b64d337e2887-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf 2023-07-20 23:12:16,450 INFO [StoreOpener-6140f6e3a6032e7d150b8a82b7f59832-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6140f6e3a6032e7d150b8a82b7f59832 columnFamilyName cf 2023-07-20 23:12:16,450 INFO [StoreOpener-9c00ded12cf919d939a1b64d337e2887-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c00ded12cf919d939a1b64d337e2887 columnFamilyName cf 2023-07-20 23:12:16,452 INFO [StoreOpener-9c00ded12cf919d939a1b64d337e2887-1] regionserver.HStore(310): Store=9c00ded12cf919d939a1b64d337e2887/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:16,452 INFO [StoreOpener-6140f6e3a6032e7d150b8a82b7f59832-1] regionserver.HStore(310): Store=6140f6e3a6032e7d150b8a82b7f59832/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 23:12:16,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:16,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:16,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:16,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6140f6e3a6032e7d150b8a82b7f59832; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62432344, jitterRate=-0.06968557834625244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:16,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6140f6e3a6032e7d150b8a82b7f59832: 2023-07-20 23:12:16,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832., pid=108, masterSystemTime=1689894736439 2023-07-20 23:12:16,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6140f6e3a6032e7d150b8a82b7f59832, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,466 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894736465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894736465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894736465"}]},"ts":"1689894736465"} 2023-07-20 23:12:16,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 23:12:16,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c00ded12cf919d939a1b64d337e2887; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65485156, jitterRate=-0.02419513463973999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 23:12:16,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c00ded12cf919d939a1b64d337e2887: 2023-07-20 23:12:16,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887., pid=109, masterSystemTime=1689894736439 2023-07-20 23:12:16,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-20 23:12:16,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 6140f6e3a6032e7d150b8a82b7f59832, server=jenkins-hbase4.apache.org,33297,1689894621380 in 180 msec 2023-07-20 23:12:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9c00ded12cf919d939a1b64d337e2887, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894736470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689894736470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689894736470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689894736470"}]},"ts":"1689894736470"} 2023-07-20 23:12:16,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, ASSIGN in 345 msec 2023-07-20 23:12:16,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-20 23:12:16,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 9c00ded12cf919d939a1b64d337e2887, server=jenkins-hbase4.apache.org,35883,1689894621465 in 184 msec 2023-07-20 23:12:16,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-20 23:12:16,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, ASSIGN in 349 msec 2023-07-20 23:12:16,476 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 23:12:16,476 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894736476"}]},"ts":"1689894736476"} 2023-07-20 23:12:16,477 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 23:12:16,481 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 23:12:16,481 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 23:12:16,483 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:16,485 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,485 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,485 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,485 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:16,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 23:12:16,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 476 msec 2023-07-20 23:12:16,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 23:12:16,622 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 23:12:16,624 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,624 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,626 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:16,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894736644 (current time:1689894736644). 2023-07-20 23:12:16,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:16,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x583ee400 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:16,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cf7b57e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:16,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:16,665 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:16,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x583ee400 to 127.0.0.1:62235 2023-07-20 23:12:16,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:16,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x3449794c to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:16,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bf89521, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:16,680 DEBUG [hconnection-0x1a258f65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:16,685 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3449794c to 127.0.0.1:62235 2023-07-20 23:12:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:16,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:16,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,701 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,702 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689895336702 2023-07-20 23:12:16,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:16,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,703 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:16,709 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:16,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:16,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-20 23:12:16,713 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:16,714 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689895336714 2023-07-20 23:12:16,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,764 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:16,764 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:16,766 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 23:12:16,766 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 23:12:16,795 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,795 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,797 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,797 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,797 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,797 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,798 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,798 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,798 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,798 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:16,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:16,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,800 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:16,800 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:16,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,804 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:16,804 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:16,804 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:16,804 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:16,804 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:16,806 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:16,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:16,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:16,807 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,811 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:16,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:16,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:16,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:16,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5bae77[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:16,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:16,818 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,820 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,820 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,820 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,820 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:16,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:16,821 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,821 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:16,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5bae77[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:16,824 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 23:12:16,824 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:16,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,825 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:16,825 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,825 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:16,826 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:16,826 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,826 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. started... 2023-07-20 23:12:16,826 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:16,826 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,826 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:16,826 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:12:16,826 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. started... 2023-07-20 23:12:16,826 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c00ded12cf919d939a1b64d337e2887: 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6140f6e3a6032e7d150b8a82b7f59832: 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:16,828 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 23:12:16,830 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:16,830 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:16,830 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:16,883 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. completed. 2023-07-20 23:12:16,883 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:16,883 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:16,883 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:16,884 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,884 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:16,884 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:12:16,886 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:16,886 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,886 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:16,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,886 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:16,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:16,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:16,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:16,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:16,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,891 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. completed. 2023-07-20 23:12:16,891 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:16,891 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:16,891 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:16,891 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,891 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:16,891 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:12:16,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:16,893 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:16,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,893 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:16,893 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,893 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:12:16,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 23:12:16,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:16,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:16,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:16,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:12:16,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 23:12:16,903 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 23:12:16,903 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:16,903 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:16,903 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,903 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:16,906 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,906 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,906 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,911 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:16,911 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,912 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,913 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,914 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,914 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,917 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:16,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:16,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,919 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:16,918 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:12:16,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 23:12:16,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,919 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,929 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:16,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:16,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:16,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:16,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:16,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,008 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,009 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:17,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 23:12:17,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,047 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689894736703Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689894736968 (+265 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894736968Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894736968Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894736974 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689894736983 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689894737047 (+64 ms) 2023-07-20 23:12:17,050 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 344 msec 2023-07-20 23:12:17,310 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:17,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:17,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33297] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 23:12:17,318 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,318 DEBUG [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:17,318 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 23:12:17,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689894737330 (current time:1689894737330). 2023-07-20 23:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 23:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x4be087c6 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:17,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d086778, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:17,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:17,368 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:17,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4be087c6 to 127.0.0.1:62235 2023-07-20 23:12:17,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:17,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(139): Connect 0x665612d3 to 127.0.0.1:62235 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 23:12:17,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29477768, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 23:12:17,381 DEBUG [hconnection-0x174af69f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 23:12:17,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 23:12:17,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x665612d3 to 127.0.0.1:62235 2023-07-20 23:12:17,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:12:17,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 23:12:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 23:12:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,397 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,398 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689895337398 2023-07-20 23:12:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 23:12:17,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,399 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 23:12:17,399 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 23:12:17,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,402 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 23:12:17,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-20 23:12:17,403 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,404 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689895337404 2023-07-20 23:12:17,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,424 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:17,424 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,444 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 23:12:17,444 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 23:12:17,445 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,445 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,447 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,447 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,448 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,448 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 23:12:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,451 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 23:12:17,456 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 23:12:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 23:12:17,457 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 23:12:17,458 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44911,1689894621546' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 23:12:17,459 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,459 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,459 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,460 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,460 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,460 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,460 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,460 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,461 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,461 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 23:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33297,1689894621380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6691c336[Count = 1] remaining members to acquire global barrier 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35883,1689894621465' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 23:12:17,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6691c336[Count = 0] remaining members to acquire global barrier 2023-07-20 23:12:17,465 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 23:12:17,465 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,470 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,470 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,470 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,471 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 23:12:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,471 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44911,1689894621546' in zk 2023-07-20 23:12:17,471 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,473 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,473 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,473 DEBUG [member: 'jenkins-hbase4.apache.org,44911,1689894621546' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,473 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,474 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 23:12:17,474 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 23:12:17,477 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 23:12:17,477 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:17,477 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:17,477 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. started... 2023-07-20 23:12:17,478 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. started... 2023-07-20 23:12:17,478 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c00ded12cf919d939a1b64d337e2887 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-20 23:12:17,478 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6140f6e3a6032e7d150b8a82b7f59832 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-20 23:12:17,499 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,501 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 23:12:17,595 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6 2023-07-20 23:12:17,625 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d 2023-07-20 23:12:17,639 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/.tmp/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 2023-07-20 23:12:17,649 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/.tmp/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 2023-07-20 23:12:17,655 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/.tmp/cf/29f6b8a8bc9349a897a916d7ce8be45a 2023-07-20 23:12:17,663 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/.tmp/cf/29f6b8a8bc9349a897a916d7ce8be45a as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a 2023-07-20 23:12:17,665 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21, entries=1, sequenceid=6, filesize=5.1 K 2023-07-20 23:12:17,668 INFO [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 9c00ded12cf919d939a1b64d337e2887 in 190ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:17,668 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 23:12:17,669 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c00ded12cf919d939a1b64d337e2887: 2023-07-20 23:12:17,669 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,669 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,669 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21] hfiles 2023-07-20 23:12:17,669 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,670 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a, entries=49, sequenceid=6, filesize=13.7 K 2023-07-20 23:12:17,672 INFO [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 6140f6e3a6032e7d150b8a82b7f59832 in 194ms, sequenceid=6, compaction requested=false 2023-07-20 23:12:17,674 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6140f6e3a6032e7d150b8a82b7f59832: 2023-07-20 23:12:17,677 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,677 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 23:12:17,677 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a] hfiles 2023-07-20 23:12:17,677 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,701 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:17,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:17,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 23:12:17,704 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 23:12:17,738 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. completed. 2023-07-20 23:12:17,738 DEBUG [rs(jenkins-hbase4.apache.org,35883,1689894621465)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,738 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,739 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,739 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35883,1689894621465' in zk 2023-07-20 23:12:17,740 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,740 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,740 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,741 DEBUG [member: 'jenkins-hbase4.apache.org,35883,1689894621465' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,743 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. completed. 2023-07-20 23:12:17,743 DEBUG [rs(jenkins-hbase4.apache.org,33297,1689894621380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 23:12:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 23:12:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 23:12:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33297,1689894621380' in zk 2023-07-20 23:12:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,745 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 23:12:17,745 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,745 DEBUG [member: 'jenkins-hbase4.apache.org,33297,1689894621380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 23:12:17,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,747 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35883,1689894621465': 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35883,1689894621465' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33297,1689894621380': 2023-07-20 23:12:17,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33297,1689894621380' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 23:12:17,757 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 23:12:17,757 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 23:12:17,757 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 23:12:17,757 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,757 INFO [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,759 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,762 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 23:12:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 23:12:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 23:12:17,763 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,764 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 23:12:17,764 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 23:12:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,777 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,778 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,779 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,788 DEBUG [(jenkins-hbase4.apache.org,42665,1689894619633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 23:12:17,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 23:12:17,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,790 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,788 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 23:12:17,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,791 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 23:12:17,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 23:12:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 23:12:17,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6] mob files 2023-07-20 23:12:17,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d 2023-07-20 23:12:17,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6 2023-07-20 23:12:17,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 23:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 23:12:17,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 23:12:17,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,871 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:17,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689894737398Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689894737824 (+426 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737824Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737824Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737832 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689894737847 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689894737871 (+24 ms) 2023-07-20 23:12:17,874 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 23:12:17,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 475 msec 2023-07-20 23:12:18,004 DEBUG [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 23:12:18,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 23:12:18,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 23:12:18,005 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005 2023-07-20 23:12:18,005 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33859, tgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005, rawTgtDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005, srcFsUri=hdfs://localhost:33859, srcDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:12:18,029 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378 2023-07-20 23:12:18,030 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_567495974_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,030 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33859, inputRoot=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378, snapshotDir=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 23:12:18,041 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:18,065 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,065 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,066 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,066 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,066 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,066 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,067 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,137 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/hadoop-271418493842594623.jar 2023-07-20 23:12:18,137 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,138 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,138 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,138 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,139 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,139 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 23:12:18,139 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 23:12:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 23:12:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 23:12:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 23:12:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 23:12:18,141 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 23:12:18,141 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 23:12:18,142 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 23:12:18,142 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 23:12:18,142 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 23:12:18,143 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,143 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,143 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:18,143 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,144 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 23:12:18,144 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:18,144 DEBUG [Listener at jenkins-hbase4.apache.org/45891] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 23:12:19,068 WARN [Listener at jenkins-hbase4.apache.org/45891] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 23:12:19,071 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 23:12:19,073 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-20 23:12:20,180 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:20,180 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 23:12:20,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0006_000001 (auth:SIMPLE) 2023-07-20 23:12:20,598 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:21,329 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:26,351 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:28,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:33,172 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689894629453_0007_000001 (auth:SIMPLE) 2023-07-20 23:12:34,322 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 23:12:34,322 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 23:12:34,345 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,345 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 23:12:34,346 INFO [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 23:12:34,346 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,347 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 23:12:34,347 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 23:12:34,347 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535092298_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,348 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 23:12:34,348 DEBUG [Listener at jenkins-hbase4.apache.org/45891] snapshot.TestExportSnapshot(367): hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/export-test/export-1689894738005/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 23:12:34,354 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894754360"}]},"ts":"1689894754360"} 2023-07-20 23:12:34,361 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 23:12:34,363 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 23:12:34,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, UNASSIGN}] 2023-07-20 23:12:34,366 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, UNASSIGN 2023-07-20 23:12:34,366 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, UNASSIGN 2023-07-20 23:12:34,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c00ded12cf919d939a1b64d337e2887, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:12:34,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6140f6e3a6032e7d150b8a82b7f59832, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:12:34,367 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894754366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894754366"}]},"ts":"1689894754366"} 2023-07-20 23:12:34,367 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689894754366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689894754366"}]},"ts":"1689894754366"} 2023-07-20 23:12:34,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 6140f6e3a6032e7d150b8a82b7f59832, server=jenkins-hbase4.apache.org,33297,1689894621380}] 2023-07-20 23:12:34,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 9c00ded12cf919d939a1b64d337e2887, server=jenkins-hbase4.apache.org,35883,1689894621465}] 2023-07-20 23:12:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6140f6e3a6032e7d150b8a82b7f59832, disabling compactions & flushes 2023-07-20 23:12:34,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. after waiting 0 ms 2023-07-20 23:12:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:34,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:34,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c00ded12cf919d939a1b64d337e2887, disabling compactions & flushes 2023-07-20 23:12:34,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:34,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:34,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. after waiting 0 ms 2023-07-20 23:12:34,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:34,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:34,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:34,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832. 2023-07-20 23:12:34,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6140f6e3a6032e7d150b8a82b7f59832: 2023-07-20 23:12:34,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:34,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6140f6e3a6032e7d150b8a82b7f59832, regionState=CLOSED 2023-07-20 23:12:34,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894754598"}]},"ts":"1689894754598"} 2023-07-20 23:12:34,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-20 23:12:34,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 6140f6e3a6032e7d150b8a82b7f59832, server=jenkins-hbase4.apache.org,33297,1689894621380 in 232 msec 2023-07-20 23:12:34,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6140f6e3a6032e7d150b8a82b7f59832, UNASSIGN in 238 msec 2023-07-20 23:12:34,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:12:34,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:12:34,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887. 2023-07-20 23:12:34,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c00ded12cf919d939a1b64d337e2887: 2023-07-20 23:12:34,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:34,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9c00ded12cf919d939a1b64d337e2887, regionState=CLOSED 2023-07-20 23:12:34,621 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689894754620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689894754620"}]},"ts":"1689894754620"} 2023-07-20 23:12:34,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-20 23:12:34,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 9c00ded12cf919d939a1b64d337e2887, server=jenkins-hbase4.apache.org,35883,1689894621465 in 256 msec 2023-07-20 23:12:34,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-20 23:12:34,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9c00ded12cf919d939a1b64d337e2887, UNASSIGN in 263 msec 2023-07-20 23:12:34,631 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689894754630"}]},"ts":"1689894754630"} 2023-07-20 23:12:34,633 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 23:12:34,634 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 23:12:34,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 280 msec 2023-07-20 23:12:34,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 23:12:34,662 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 23:12:34,663 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,668 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,669 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33297] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,672 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,672 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,672 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,672 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,675 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,674 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,675 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 23:12:34,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 23:12:34,687 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:34,696 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:34,699 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/recovered.edits] 2023-07-20 23:12:34,702 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf, FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/recovered.edits] 2023-07-20 23:12:34,704 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/cf/cf3a3da95ffc4fe58d92d5af59ac3b21 2023-07-20 23:12:34,708 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/cf/29f6b8a8bc9349a897a916d7ce8be45a 2023-07-20 23:12:34,709 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887/recovered.edits/9.seqid 2023-07-20 23:12:34,710 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9c00ded12cf919d939a1b64d337e2887 2023-07-20 23:12:34,713 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/recovered.edits/9.seqid to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832/recovered.edits/9.seqid 2023-07-20 23:12:34,714 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6140f6e3a6032e7d150b8a82b7f59832 2023-07-20 23:12:34,714 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 23:12:34,714 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 23:12:34,720 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-20 23:12:34,723 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230720f2ce3ae8ae2b41ce9bd702afdaf7585d 2023-07-20 23:12:34,725 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6 to hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230720e979550cb5d9435fab2fcb2b5a8977c6 2023-07-20 23:12:34,725 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 23:12:34,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,732 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 23:12:34,736 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 23:12:34,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,737 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 23:12:34,738 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894754737"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:34,738 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689894754737"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:34,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 23:12:34,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c00ded12cf919d939a1b64d337e2887, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689894736011.9c00ded12cf919d939a1b64d337e2887.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6140f6e3a6032e7d150b8a82b7f59832, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689894736011.6140f6e3a6032e7d150b8a82b7f59832.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 23:12:34,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 23:12:34,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689894754740"}]},"ts":"9223372036854775807"} 2023-07-20 23:12:34,743 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 23:12:34,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 83 msec 2023-07-20 23:12:34,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 23:12:34,777 INFO [Listener at jenkins-hbase4.apache.org/45891] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 23:12:34,784 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 23:12:34,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 23:12:34,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 23:12:34,818 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:44854 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:33878 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-535092298_17 at /127.0.0.1:39180 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5545 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_553566768_1 at /127.0.0.1:39158 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:38551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_553566768_1 at /127.0.0.1:44832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2920c70d-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=734 (was 662) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1337 (was 263) - AvailableMemoryMB LEAK? - 2023-07-20 23:12:34,818 WARN [Listener at jenkins-hbase4.apache.org/45891] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 23:12:34,818 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 23:12:34,830 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:12:34,940 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689894629453_0007_01_000001 is : 143 2023-07-20 23:12:40,170 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 23:12:48,954 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,082 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,083 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,198 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 23:13:03,212 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 23:13:03,214 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,224 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 23:13:03,328 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 23:13:03,328 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 23:13:03,328 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 23:13:03,328 INFO [Listener at jenkins-hbase4.apache.org/45891] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 23:13:03,328 DEBUG [Listener at jenkins-hbase4.apache.org/45891] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ed2880 to 127.0.0.1:62235 2023-07-20 23:13:03,328 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,329 DEBUG [Listener at jenkins-hbase4.apache.org/45891] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 23:13:03,329 DEBUG [Listener at jenkins-hbase4.apache.org/45891] util.JVMClusterUtil(257): Found active master hash=1245815773, stopped=false 2023-07-20 23:13:03,330 DEBUG [Listener at jenkins-hbase4.apache.org/45891] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,330 DEBUG [Listener at jenkins-hbase4.apache.org/45891] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 23:13:03,330 INFO [Listener at jenkins-hbase4.apache.org/45891] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:13:03,387 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,387 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,387 INFO [Listener at jenkins-hbase4.apache.org/45891] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 23:13:03,387 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,387 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 23:13:03,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,387 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:13:03,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,387 DEBUG [Listener at jenkins-hbase4.apache.org/45891] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4da945dc to 127.0.0.1:62235 2023-07-20 23:13:03,388 DEBUG [Listener at jenkins-hbase4.apache.org/45891] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 23:13:03,388 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33297,1689894621380' ***** 2023-07-20 23:13:03,389 DEBUG [Listener at jenkins-hbase4.apache.org/45891] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,389 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,389 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35883,1689894621465' ***** 2023-07-20 23:13:03,389 DEBUG [Listener at jenkins-hbase4.apache.org/45891] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,389 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,389 INFO [RS:0;jenkins-hbase4:33297] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,389 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44911,1689894621546' ***** 2023-07-20 23:13:03,389 DEBUG [Listener at jenkins-hbase4.apache.org/45891] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,389 INFO [Listener at jenkins-hbase4.apache.org/45891] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 23:13:03,389 INFO [RS:1;jenkins-hbase4:35883] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,389 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,389 INFO [RS:1;jenkins-hbase4:35883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,389 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,389 INFO [RS:0;jenkins-hbase4:33297] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,390 INFO [RS:1;jenkins-hbase4:35883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,390 INFO [RS:0;jenkins-hbase4:33297] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,390 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:13:03,390 DEBUG [RS:1;jenkins-hbase4:35883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79fb140c to 127.0.0.1:62235 2023-07-20 23:13:03,390 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(3305): Received CLOSE for aa015f061d3a740005ba418c42ee773f 2023-07-20 23:13:03,390 DEBUG [RS:1;jenkins-hbase4:35883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,392 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35883,1689894621465; all regions closed. 2023-07-20 23:13:03,392 INFO [RS:2;jenkins-hbase4:44911] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 23:13:03,392 INFO [RS:2;jenkins-hbase4:44911] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 23:13:03,392 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(3305): Received CLOSE for 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:13:03,393 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:13:03,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aa015f061d3a740005ba418c42ee773f, disabling compactions & flushes 2023-07-20 23:13:03,392 INFO [RS:2;jenkins-hbase4:44911] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 23:13:03,393 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:13:03,393 DEBUG [RS:2;jenkins-hbase4:44911] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ec7e634 to 127.0.0.1:62235 2023-07-20 23:13:03,392 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 23:13:03,393 DEBUG [RS:2;jenkins-hbase4:44911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:13:03,393 DEBUG [RS:0;jenkins-hbase4:33297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05fe5da4 to 127.0.0.1:62235 2023-07-20 23:13:03,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:13:03,395 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44911,1689894621546; all regions closed. 2023-07-20 23:13:03,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. after waiting 0 ms 2023-07-20 23:13:03,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:13:03,393 DEBUG [RS:0;jenkins-hbase4:33297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing aa015f061d3a740005ba418c42ee773f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 23:13:03,396 INFO [RS:0;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,397 INFO [RS:0;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,397 INFO [RS:0;jenkins-hbase4:33297] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,397 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 23:13:03,397 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-20 23:13:03,397 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1478): Online Regions={aa015f061d3a740005ba418c42ee773f=hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f., 1588230740=hbase:meta,,1.1588230740, 64a30d165b3faa5d7b67f444c416918b=hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b.} 2023-07-20 23:13:03,398 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1504): Waiting on 1588230740, 64a30d165b3faa5d7b67f444c416918b, aa015f061d3a740005ba418c42ee773f 2023-07-20 23:13:03,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 23:13:03,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 23:13:03,401 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 23:13:03,401 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 23:13:03,401 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 23:13:03,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 23:13:03,406 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,414 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,414 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,436 DEBUG [RS:2;jenkins-hbase4:44911] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs 2023-07-20 23:13:03,436 INFO [RS:2;jenkins-hbase4:44911] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44911%2C1689894621546:(num 1689894623705) 2023-07-20 23:13:03,436 DEBUG [RS:2;jenkins-hbase4:44911] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,436 INFO [RS:2;jenkins-hbase4:44911] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,436 DEBUG [RS:1;jenkins-hbase4:35883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs 2023-07-20 23:13:03,437 INFO [RS:1;jenkins-hbase4:35883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35883%2C1689894621465:(num 1689894623707) 2023-07-20 23:13:03,437 DEBUG [RS:1;jenkins-hbase4:35883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,437 INFO [RS:1;jenkins-hbase4:35883] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,451 INFO [RS:1;jenkins-hbase4:35883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,451 INFO [RS:1;jenkins-hbase4:35883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,451 INFO [RS:1;jenkins-hbase4:35883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,451 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,451 INFO [RS:1;jenkins-hbase4:35883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,454 INFO [RS:2;jenkins-hbase4:44911] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,455 INFO [RS:2;jenkins-hbase4:44911] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 23:13:03,455 INFO [RS:1;jenkins-hbase4:35883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35883 2023-07-20 23:13:03,455 INFO [RS:2;jenkins-hbase4:44911] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 23:13:03,456 INFO [RS:2;jenkins-hbase4:44911] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 23:13:03,455 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,457 INFO [RS:2;jenkins-hbase4:44911] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44911 2023-07-20 23:13:03,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/.tmp/info/46315a1152ba42989366d883df2dabf6 2023-07-20 23:13:03,467 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/info/3d38aeb8827e4d8c9baa09aae33682d9 2023-07-20 23:13:03,472 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d38aeb8827e4d8c9baa09aae33682d9 2023-07-20 23:13:03,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/.tmp/info/46315a1152ba42989366d883df2dabf6 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/info/46315a1152ba42989366d883df2dabf6 2023-07-20 23:13:03,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/info/46315a1152ba42989366d883df2dabf6, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 23:13:03,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for aa015f061d3a740005ba418c42ee773f in 88ms, sequenceid=6, compaction requested=false 2023-07-20 23:13:03,491 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-20 23:13:03,493 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-20 23:13:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/namespace/aa015f061d3a740005ba418c42ee773f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 23:13:03,548 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:13:03,548 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,549 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,549 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:13:03,549 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,550 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44911,1689894621546 2023-07-20 23:13:03,550 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/rep_barrier/157aee2fb1024dd7bc855149cb960eef 2023-07-20 23:13:03,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:13:03,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aa015f061d3a740005ba418c42ee773f: 2023-07-20 23:13:03,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689894624487.aa015f061d3a740005ba418c42ee773f. 2023-07-20 23:13:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 64a30d165b3faa5d7b67f444c416918b, disabling compactions & flushes 2023-07-20 23:13:03,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:13:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:13:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. after waiting 0 ms 2023-07-20 23:13:03,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:13:03,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 64a30d165b3faa5d7b67f444c416918b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 23:13:03,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 157aee2fb1024dd7bc855149cb960eef 2023-07-20 23:13:03,571 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:13:03,571 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:13:03,571 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44911,1689894621546] 2023-07-20 23:13:03,573 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35883,1689894621465 2023-07-20 23:13:03,575 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44911,1689894621546; numProcessing=1 2023-07-20 23:13:03,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/.tmp/l/ef07eb7a16c3427a811eae1ae141e1ce 2023-07-20 23:13:03,594 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44911,1689894621546 already deleted, retry=false 2023-07-20 23:13:03,594 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44911,1689894621546 expired; onlineServers=2 2023-07-20 23:13:03,594 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35883,1689894621465] 2023-07-20 23:13:03,594 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35883,1689894621465; numProcessing=2 2023-07-20 23:13:03,598 DEBUG [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1504): Waiting on 1588230740, 64a30d165b3faa5d7b67f444c416918b 2023-07-20 23:13:03,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/table/21a28886285045a28b9c8553baaaa8b3 2023-07-20 23:13:03,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef07eb7a16c3427a811eae1ae141e1ce 2023-07-20 23:13:03,601 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35883,1689894621465 already deleted, retry=false 2023-07-20 23:13:03,601 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35883,1689894621465 expired; onlineServers=1 2023-07-20 23:13:03,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21a28886285045a28b9c8553baaaa8b3 2023-07-20 23:13:03,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/info/3d38aeb8827e4d8c9baa09aae33682d9 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/info/3d38aeb8827e4d8c9baa09aae33682d9 2023-07-20 23:13:03,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/.tmp/l/ef07eb7a16c3427a811eae1ae141e1ce as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/l/ef07eb7a16c3427a811eae1ae141e1ce 2023-07-20 23:13:03,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d38aeb8827e4d8c9baa09aae33682d9 2023-07-20 23:13:03,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/info/3d38aeb8827e4d8c9baa09aae33682d9, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 23:13:03,625 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/rep_barrier/157aee2fb1024dd7bc855149cb960eef as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/rep_barrier/157aee2fb1024dd7bc855149cb960eef 2023-07-20 23:13:03,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 157aee2fb1024dd7bc855149cb960eef 2023-07-20 23:13:03,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/rep_barrier/157aee2fb1024dd7bc855149cb960eef, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 23:13:03,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef07eb7a16c3427a811eae1ae141e1ce 2023-07-20 23:13:03,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/l/ef07eb7a16c3427a811eae1ae141e1ce, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 23:13:03,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 64a30d165b3faa5d7b67f444c416918b in 85ms, sequenceid=18, compaction requested=false 2023-07-20 23:13:03,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/.tmp/table/21a28886285045a28b9c8553baaaa8b3 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/table/21a28886285045a28b9c8553baaaa8b3 2023-07-20 23:13:03,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21a28886285045a28b9c8553baaaa8b3 2023-07-20 23:13:03,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/table/21a28886285045a28b9c8553baaaa8b3, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 23:13:03,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 247ms, sequenceid=131, compaction requested=false 2023-07-20 23:13:03,686 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,687 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:44911-0x101850009410003, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,687 INFO [RS:2;jenkins-hbase4:44911] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44911,1689894621546; zookeeper connection closed. 2023-07-20 23:13:03,703 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a50b141] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a50b141 2023-07-20 23:13:03,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/acl/64a30d165b3faa5d7b67f444c416918b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 23:13:03,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:13:03,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 64a30d165b3faa5d7b67f444c416918b: 2023-07-20 23:13:03,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689894625272.64a30d165b3faa5d7b67f444c416918b. 2023-07-20 23:13:03,736 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 23:13:03,737 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 23:13:03,737 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 23:13:03,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 23:13:03,738 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 23:13:03,738 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 23:13:03,787 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,787 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:35883-0x101850009410002, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,787 INFO [RS:1;jenkins-hbase4:35883] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35883,1689894621465; zookeeper connection closed. 2023-07-20 23:13:03,790 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64b62d7f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64b62d7f 2023-07-20 23:13:03,799 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33297,1689894621380; all regions closed. 2023-07-20 23:13:03,818 DEBUG [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs 2023-07-20 23:13:03,818 INFO [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33297%2C1689894621380.meta:.meta(num 1689894624047) 2023-07-20 23:13:03,829 DEBUG [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/oldWALs 2023-07-20 23:13:03,829 INFO [RS:0;jenkins-hbase4:33297] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33297%2C1689894621380:(num 1689894623705) 2023-07-20 23:13:03,829 DEBUG [RS:0;jenkins-hbase4:33297] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,829 INFO [RS:0;jenkins-hbase4:33297] regionserver.LeaseManager(133): Closed leases 2023-07-20 23:13:03,829 INFO [RS:0;jenkins-hbase4:33297] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 23:13:03,829 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:03,831 INFO [RS:0;jenkins-hbase4:33297] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33297 2023-07-20 23:13:03,833 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 23:13:03,833 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33297,1689894621380 2023-07-20 23:13:03,836 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33297,1689894621380] 2023-07-20 23:13:03,836 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33297,1689894621380; numProcessing=3 2023-07-20 23:13:03,937 INFO [RS:0;jenkins-hbase4:33297] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33297,1689894621380; zookeeper connection closed. 2023-07-20 23:13:03,937 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,937 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): regionserver:33297-0x101850009410001, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:03,938 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@481ce33c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@481ce33c 2023-07-20 23:13:03,938 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33297,1689894621380 already deleted, retry=false 2023-07-20 23:13:03,938 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33297,1689894621380 expired; onlineServers=0 2023-07-20 23:13:03,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42665,1689894619633' ***** 2023-07-20 23:13:03,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 23:13:03,938 INFO [Listener at jenkins-hbase4.apache.org/45891] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 23:13:03,938 DEBUG [M:0;jenkins-hbase4:42665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7ca9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 23:13:03,939 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42665,1689894619633 2023-07-20 23:13:03,939 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42665,1689894619633; all regions closed. 2023-07-20 23:13:03,939 DEBUG [M:0;jenkins-hbase4:42665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 23:13:03,939 DEBUG [M:0;jenkins-hbase4:42665] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 23:13:03,939 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 23:13:03,939 DEBUG [M:0;jenkins-hbase4:42665] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 23:13:03,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623173] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689894623173,5,FailOnTimeoutGroup] 2023-07-20 23:13:03,939 INFO [M:0;jenkins-hbase4:42665] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 23:13:03,939 INFO [M:0;jenkins-hbase4:42665] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 23:13:03,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623174] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689894623174,5,FailOnTimeoutGroup] 2023-07-20 23:13:03,940 INFO [M:0;jenkins-hbase4:42665] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 23:13:03,940 DEBUG [M:0;jenkins-hbase4:42665] master.HMaster(1512): Stopping service threads 2023-07-20 23:13:03,940 INFO [M:0;jenkins-hbase4:42665] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 23:13:03,941 ERROR [M:0;jenkins-hbase4:42665] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 23:13:03,942 INFO [M:0;jenkins-hbase4:42665] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 23:13:03,942 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 23:13:03,942 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 23:13:03,942 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 23:13:03,942 DEBUG [M:0;jenkins-hbase4:42665] zookeeper.ZKUtil(398): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 23:13:03,943 WARN [M:0;jenkins-hbase4:42665] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 23:13:03,943 INFO [M:0;jenkins-hbase4:42665] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 23:13:03,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 23:13:03,943 INFO [M:0;jenkins-hbase4:42665] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 23:13:03,945 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 23:13:03,945 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,945 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,945 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 23:13:03,945 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:03,945 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.83 KB heapSize=452.10 KB 2023-07-20 23:13:04,006 INFO [M:0;jenkins-hbase4:42665] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.83 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5c4c4ce23464594a99b9a799820c7b5 2023-07-20 23:13:04,012 INFO [M:0;jenkins-hbase4:42665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5c4c4ce23464594a99b9a799820c7b5 2023-07-20 23:13:04,013 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5c4c4ce23464594a99b9a799820c7b5 as hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5c4c4ce23464594a99b9a799820c7b5 2023-07-20 23:13:04,018 INFO [M:0;jenkins-hbase4:42665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5c4c4ce23464594a99b9a799820c7b5 2023-07-20 23:13:04,018 INFO [M:0;jenkins-hbase4:42665] regionserver.HStore(1080): Added hdfs://localhost:33859/user/jenkins/test-data/9c751a20-8e25-fced-a220-dd6131b6a378/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5c4c4ce23464594a99b9a799820c7b5, entries=119, sequenceid=899, filesize=28.7 K 2023-07-20 23:13:04,019 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegion(2948): Finished flush of dataSize ~375.83 KB/384846, heapSize ~452.09 KB/462936, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 74ms, sequenceid=899, compaction requested=false 2023-07-20 23:13:04,022 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 23:13:04,022 DEBUG [M:0;jenkins-hbase4:42665] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 23:13:04,031 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 23:13:04,031 INFO [M:0;jenkins-hbase4:42665] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 23:13:04,032 INFO [M:0;jenkins-hbase4:42665] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42665 2023-07-20 23:13:04,037 DEBUG [M:0;jenkins-hbase4:42665] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42665,1689894619633 already deleted, retry=false 2023-07-20 23:13:04,139 INFO [M:0;jenkins-hbase4:42665] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42665,1689894619633; zookeeper connection closed. 2023-07-20 23:13:04,139 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,139 DEBUG [Listener at localhost/40933-EventThread] zookeeper.ZKWatcher(600): master:42665-0x101850009410000, quorum=127.0.0.1:62235, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 23:13:04,141 WARN [Listener at jenkins-hbase4.apache.org/45891] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,161 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,162 WARN [209476610@qtp-380283415-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37729] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-20 23:13:04,162 WARN [209476610@qtp-380283415-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37729] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-20 23:13:04,267 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,268 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1730988018-172.31.14.131-1689894615440 (Datanode Uuid 48de7011-776e-48a6-9217-4cdc988acafe) service to localhost/127.0.0.1:33859 2023-07-20 23:13:04,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data5/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data6/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,272 WARN [Listener at jenkins-hbase4.apache.org/45891] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,276 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,381 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,381 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1730988018-172.31.14.131-1689894615440 (Datanode Uuid c3029a52-7b03-4f0f-a252-206a22a5741f) service to localhost/127.0.0.1:33859 2023-07-20 23:13:04,382 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data3/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data4/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,384 WARN [Listener at jenkins-hbase4.apache.org/45891] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 23:13:04,389 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,494 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 23:13:04,494 WARN [BP-1730988018-172.31.14.131-1689894615440 heartbeating to localhost/127.0.0.1:33859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1730988018-172.31.14.131-1689894615440 (Datanode Uuid 84c623c4-2f76-44da-9e2f-f864d52de778) service to localhost/127.0.0.1:33859 2023-07-20 23:13:04,495 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data2/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/455b97a7-55f5-a9ba-b6cb-ea12bd8086ee/cluster_1f0fd45b-af55-231d-51b1-ff78c493ff1c/dfs/data/data1/current/BP-1730988018-172.31.14.131-1689894615440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 23:13:04,538 INFO [Listener at jenkins-hbase4.apache.org/45891] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 23:13:04,677 INFO [Listener at jenkins-hbase4.apache.org/45891] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 23:13:04,786 INFO [Listener at jenkins-hbase4.apache.org/45891] hbase.HBaseTestingUtility(1293): Minicluster is down