2023-07-13 07:13:15,511 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-13 07:13:15,722 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553 2023-07-13 07:13:15,723 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-13 07:13:15,723 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-13 07:13:15,776 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-13 07:13:15,996 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-13 07:13:15,996 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8, deleteOnExit=true 2023-07-13 07:13:15,996 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-13 07:13:15,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/test.cache.data in system properties and HBase conf 2023-07-13 07:13:15,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 07:13:15,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop.log.dir in system properties and HBase conf 2023-07-13 07:13:15,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 07:13:15,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 07:13:15,999 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 07:13:16,294 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-13 07:13:16,299 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:13:16,300 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:13:16,300 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 07:13:16,301 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:13:16,301 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 07:13:16,302 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 07:13:16,302 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:13:16,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:13:16,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 07:13:16,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/nfs.dump.dir in system properties and HBase conf 2023-07-13 07:13:16,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir in system properties and HBase conf 2023-07-13 07:13:16,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:13:16,305 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 07:13:16,305 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-13 07:13:16,935 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 07:13:16,938 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 07:13:17,309 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-13 07:13:17,479 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-13 07:13:17,492 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:17,527 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:17,571 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_localhost_localdomain_41675_hdfs____.i3s2sv/webapp 2023-07-13 07:13:17,730 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41675 2023-07-13 07:13:17,753 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-13 07:13:17,753 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-13 07:13:18,388 WARN [Listener at localhost.localdomain/42973] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:13:18,481 WARN [Listener at localhost.localdomain/42973] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:13:18,514 WARN [Listener at localhost.localdomain/42973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:18,524 INFO [Listener at localhost.localdomain/42973] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:18,531 INFO [Listener at localhost.localdomain/42973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_localhost_40583_datanode____.eobpd1/webapp 2023-07-13 07:13:18,643 INFO [Listener at localhost.localdomain/42973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40583 2023-07-13 07:13:19,101 WARN [Listener at localhost.localdomain/37833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:13:19,172 WARN [Listener at localhost.localdomain/37833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:13:19,184 WARN [Listener at localhost.localdomain/37833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:19,189 INFO [Listener at localhost.localdomain/37833] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:19,205 INFO [Listener at localhost.localdomain/37833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_localhost_41057_datanode____.1leg4/webapp 2023-07-13 07:13:19,329 INFO [Listener at localhost.localdomain/37833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41057 2023-07-13 07:13:19,350 WARN [Listener at localhost.localdomain/40531] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:13:19,447 WARN [Listener at localhost.localdomain/40531] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-13 07:13:19,451 WARN [Listener at localhost.localdomain/40531] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:19,453 INFO [Listener at localhost.localdomain/40531] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:19,461 INFO [Listener at localhost.localdomain/40531] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_localhost_32961_datanode____16idzw/webapp 2023-07-13 07:13:19,643 INFO [Listener at localhost.localdomain/40531] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32961 2023-07-13 07:13:19,679 WARN [Listener at localhost.localdomain/36337] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-13 07:13:19,769 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4885d0e6187c90b: Processing first storage report for DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5 from datanode 1a22c73d-f2f1-4d11-a101-aef5e664738a 2023-07-13 07:13:19,770 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4885d0e6187c90b: from storage DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5 node DatanodeRegistration(127.0.0.1:34655, datanodeUuid=1a22c73d-f2f1-4d11-a101-aef5e664738a, infoPort=34503, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 07:13:19,770 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1b34d4f668695c92: Processing first storage report for DS-28513881-e91b-44a0-920c-e14aa49a7120 from datanode 4f0d2746-6221-497b-bfc3-dde203fa3751 2023-07-13 07:13:19,770 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1b34d4f668695c92: from storage DS-28513881-e91b-44a0-920c-e14aa49a7120 node DatanodeRegistration(127.0.0.1:34309, datanodeUuid=4f0d2746-6221-497b-bfc3-dde203fa3751, infoPort=45235, infoSecurePort=0, ipcPort=40531, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:13:19,770 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4885d0e6187c90b: Processing first storage report for DS-7d59b45b-96ba-4afd-8af7-a4426da07d7b from datanode 1a22c73d-f2f1-4d11-a101-aef5e664738a 2023-07-13 07:13:19,771 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4885d0e6187c90b: from storage DS-7d59b45b-96ba-4afd-8af7-a4426da07d7b node DatanodeRegistration(127.0.0.1:34655, datanodeUuid=1a22c73d-f2f1-4d11-a101-aef5e664738a, infoPort=34503, infoSecurePort=0, ipcPort=37833, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:13:19,771 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1b34d4f668695c92: Processing first storage report for DS-7b01b183-b798-4d65-9f13-9c322328d0f0 from datanode 4f0d2746-6221-497b-bfc3-dde203fa3751 2023-07-13 07:13:19,771 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1b34d4f668695c92: from storage DS-7b01b183-b798-4d65-9f13-9c322328d0f0 node DatanodeRegistration(127.0.0.1:34309, datanodeUuid=4f0d2746-6221-497b-bfc3-dde203fa3751, infoPort=45235, infoSecurePort=0, ipcPort=40531, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:13:19,800 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdbc149519d84b690: Processing first storage report for DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37 from datanode efa08b05-20ce-44a2-bf70-9c6c5f7410d6 2023-07-13 07:13:19,801 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdbc149519d84b690: from storage DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37 node DatanodeRegistration(127.0.0.1:35905, datanodeUuid=efa08b05-20ce-44a2-bf70-9c6c5f7410d6, infoPort=45417, infoSecurePort=0, ipcPort=36337, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-13 07:13:19,801 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdbc149519d84b690: Processing first storage report for DS-3f4c3f3e-ef02-4556-91d5-46c9968c65c8 from datanode efa08b05-20ce-44a2-bf70-9c6c5f7410d6 2023-07-13 07:13:19,801 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdbc149519d84b690: from storage DS-3f4c3f3e-ef02-4556-91d5-46c9968c65c8 node DatanodeRegistration(127.0.0.1:35905, datanodeUuid=efa08b05-20ce-44a2-bf70-9c6c5f7410d6, infoPort=45417, infoSecurePort=0, ipcPort=36337, storageInfo=lv=-57;cid=testClusterID;nsid=1416619842;c=1689232397005), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-13 07:13:20,073 DEBUG [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553 2023-07-13 07:13:20,156 INFO [Listener at localhost.localdomain/36337] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/zookeeper_0, clientPort=61300, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-13 07:13:20,171 INFO [Listener at localhost.localdomain/36337] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61300 2023-07-13 07:13:20,178 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:20,180 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:20,796 INFO [Listener at localhost.localdomain/36337] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 with version=8 2023-07-13 07:13:20,796 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/hbase-staging 2023-07-13 07:13:21,108 INFO [Listener at localhost.localdomain/36337] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-13 07:13:21,603 INFO [Listener at localhost.localdomain/36337] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:13:21,637 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:21,637 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:21,637 INFO [Listener at localhost.localdomain/36337] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:13:21,638 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:21,638 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:13:21,773 INFO [Listener at localhost.localdomain/36337] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:13:21,847 DEBUG [Listener at localhost.localdomain/36337] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-13 07:13:21,954 INFO [Listener at localhost.localdomain/36337] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36645 2023-07-13 07:13:21,966 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:21,969 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:21,995 INFO [Listener at localhost.localdomain/36337] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36645 connecting to ZooKeeper ensemble=127.0.0.1:61300 2023-07-13 07:13:22,049 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:366450x0, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:13:22,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36645-0x100852d5b890000 connected 2023-07-13 07:13:22,099 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:13:22,100 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:13:22,111 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:13:22,121 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36645 2023-07-13 07:13:22,121 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36645 2023-07-13 07:13:22,122 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36645 2023-07-13 07:13:22,124 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36645 2023-07-13 07:13:22,126 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36645 2023-07-13 07:13:22,133 INFO [Listener at localhost.localdomain/36337] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, hbase.cluster.distributed=false 2023-07-13 07:13:22,207 INFO [Listener at localhost.localdomain/36337] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:13:22,207 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,207 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,208 INFO [Listener at localhost.localdomain/36337] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:13:22,208 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,208 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:13:22,214 INFO [Listener at localhost.localdomain/36337] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:13:22,218 INFO [Listener at localhost.localdomain/36337] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44055 2023-07-13 07:13:22,222 INFO [Listener at localhost.localdomain/36337] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:13:22,230 INFO [Listener at localhost.localdomain/36337] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 07:13:22,232 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,235 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,238 INFO [Listener at localhost.localdomain/36337] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44055 connecting to ZooKeeper ensemble=127.0.0.1:61300 2023-07-13 07:13:22,241 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:440550x0, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:13:22,242 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:440550x0, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:13:22,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44055-0x100852d5b890001 connected 2023-07-13 07:13:22,251 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:13:22,252 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:13:22,258 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44055 2023-07-13 07:13:22,262 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44055 2023-07-13 07:13:22,267 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44055 2023-07-13 07:13:22,270 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44055 2023-07-13 07:13:22,270 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44055 2023-07-13 07:13:22,287 INFO [Listener at localhost.localdomain/36337] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:13:22,288 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,288 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,289 INFO [Listener at localhost.localdomain/36337] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:13:22,289 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,290 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:13:22,291 INFO [Listener at localhost.localdomain/36337] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:13:22,300 INFO [Listener at localhost.localdomain/36337] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38771 2023-07-13 07:13:22,301 INFO [Listener at localhost.localdomain/36337] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:13:22,302 INFO [Listener at localhost.localdomain/36337] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 07:13:22,303 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,305 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,307 INFO [Listener at localhost.localdomain/36337] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38771 connecting to ZooKeeper ensemble=127.0.0.1:61300 2023-07-13 07:13:22,319 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:387710x0, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:13:22,320 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:387710x0, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:13:22,321 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:387710x0, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:13:22,322 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:387710x0, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:13:22,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38771-0x100852d5b890002 connected 2023-07-13 07:13:22,326 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38771 2023-07-13 07:13:22,326 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38771 2023-07-13 07:13:22,327 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38771 2023-07-13 07:13:22,330 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38771 2023-07-13 07:13:22,331 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38771 2023-07-13 07:13:22,347 INFO [Listener at localhost.localdomain/36337] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-13 07:13:22,347 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,347 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,348 INFO [Listener at localhost.localdomain/36337] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-13 07:13:22,348 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-13 07:13:22,348 INFO [Listener at localhost.localdomain/36337] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-13 07:13:22,348 INFO [Listener at localhost.localdomain/36337] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-13 07:13:22,352 INFO [Listener at localhost.localdomain/36337] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46789 2023-07-13 07:13:22,352 INFO [Listener at localhost.localdomain/36337] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-13 07:13:22,353 INFO [Listener at localhost.localdomain/36337] mob.MobFileCache(124): MobFileCache disabled 2023-07-13 07:13:22,355 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,357 INFO [Listener at localhost.localdomain/36337] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,359 INFO [Listener at localhost.localdomain/36337] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46789 connecting to ZooKeeper ensemble=127.0.0.1:61300 2023-07-13 07:13:22,368 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:467890x0, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-13 07:13:22,369 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:467890x0, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:13:22,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46789-0x100852d5b890003 connected 2023-07-13 07:13:22,371 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:13:22,371 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-13 07:13:22,379 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46789 2023-07-13 07:13:22,379 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46789 2023-07-13 07:13:22,380 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46789 2023-07-13 07:13:22,382 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46789 2023-07-13 07:13:22,382 DEBUG [Listener at localhost.localdomain/36337] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46789 2023-07-13 07:13:22,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:22,398 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 07:13:22,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:22,418 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:13:22,418 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:13:22,418 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:13:22,418 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-13 07:13:22,418 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:22,420 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 07:13:22,422 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,36645,1689232400946 from backup master directory 2023-07-13 07:13:22,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-13 07:13:22,430 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:22,430 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-13 07:13:22,435 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:13:22,435 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:22,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-13 07:13:22,440 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-13 07:13:22,579 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/hbase.id with ID: 90476c67-826d-4301-96a0-47c0eb14a3b7 2023-07-13 07:13:22,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-13 07:13:22,659 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:22,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x650e8b45 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:22,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5075c0ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:22,809 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:13:22,811 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-13 07:13:22,829 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-13 07:13:22,829 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-13 07:13:22,831 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:13:22,837 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:13:22,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:13:22,876 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store-tmp 2023-07-13 07:13:22,949 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:22,949 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 07:13:22,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:13:22,949 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:13:22,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 07:13:22,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:13:22,950 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:13:22,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:13:22,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/WALs/jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:22,981 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36645%2C1689232400946, suffix=, logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/WALs/jenkins-hbase20.apache.org,36645,1689232400946, archiveDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/oldWALs, maxLogs=10 2023-07-13 07:13:23,065 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK] 2023-07-13 07:13:23,071 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK] 2023-07-13 07:13:23,074 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK] 2023-07-13 07:13:23,083 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-13 07:13:23,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/WALs/jenkins-hbase20.apache.org,36645,1689232400946/jenkins-hbase20.apache.org%2C36645%2C1689232400946.1689232402991 2023-07-13 07:13:23,181 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK], DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK], DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK]] 2023-07-13 07:13:23,182 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:13:23,183 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:23,187 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,188 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,253 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,262 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-13 07:13:23,308 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-13 07:13:23,328 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:23,338 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,340 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,364 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-13 07:13:23,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:23,370 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73949493, jitterRate=0.1019333153963089}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:23,370 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:13:23,371 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-13 07:13:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-13 07:13:23,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-13 07:13:23,394 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-13 07:13:23,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-13 07:13:23,444 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 46 msec 2023-07-13 07:13:23,444 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-13 07:13:23,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-13 07:13:23,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-13 07:13:23,525 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-13 07:13:23,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-13 07:13:23,534 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-13 07:13:23,540 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-13 07:13:23,544 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-13 07:13:23,546 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:23,548 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-13 07:13:23,549 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-13 07:13:23,585 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-13 07:13:23,591 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:13:23,591 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:13:23,591 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:13:23,592 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-13 07:13:23,592 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:23,595 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,36645,1689232400946, sessionid=0x100852d5b890000, setting cluster-up flag (Was=false) 2023-07-13 07:13:23,616 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:23,621 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-13 07:13:23,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:23,650 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:23,653 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-13 07:13:23,655 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:23,657 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp 2023-07-13 07:13:23,688 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(951): ClusterId : 90476c67-826d-4301-96a0-47c0eb14a3b7 2023-07-13 07:13:23,689 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(951): ClusterId : 90476c67-826d-4301-96a0-47c0eb14a3b7 2023-07-13 07:13:23,688 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(951): ClusterId : 90476c67-826d-4301-96a0-47c0eb14a3b7 2023-07-13 07:13:23,696 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:13:23,696 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:13:23,696 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-13 07:13:23,702 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:13:23,702 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:13:23,703 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:13:23,703 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:13:23,706 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:13:23,706 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:13:23,713 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ReadOnlyZKClient(139): Connect 0x0dec1bd5 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:23,713 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ReadOnlyZKClient(139): Connect 0x1a83f116 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:23,715 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-13 07:13:23,715 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-13 07:13:23,724 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-13 07:13:23,725 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ReadOnlyZKClient(139): Connect 0x4324038e to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:23,750 DEBUG [RS:0;jenkins-hbase20:44055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eb934e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:23,751 DEBUG [RS:1;jenkins-hbase20:38771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ed6edb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:23,751 DEBUG [RS:0;jenkins-hbase20:44055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@533966c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:13:23,752 DEBUG [RS:2;jenkins-hbase20:46789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28879f7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:23,752 DEBUG [RS:1;jenkins-hbase20:38771] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7559957a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:13:23,752 DEBUG [RS:2;jenkins-hbase20:46789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f0e5b8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:13:23,756 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-13 07:13:23,761 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:23,761 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-13 07:13:23,777 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:44055 2023-07-13 07:13:23,777 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:46789 2023-07-13 07:13:23,778 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:38771 2023-07-13 07:13:23,782 INFO [RS:0;jenkins-hbase20:44055] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:13:23,783 INFO [RS:0;jenkins-hbase20:44055] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:13:23,782 INFO [RS:2;jenkins-hbase20:46789] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:13:23,783 INFO [RS:2;jenkins-hbase20:46789] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:13:23,782 INFO [RS:1;jenkins-hbase20:38771] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-13 07:13:23,783 INFO [RS:1;jenkins-hbase20:38771] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-13 07:13:23,783 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:13:23,783 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:13:23,783 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-13 07:13:23,784 INFO [RS:2;jenkins-hbase20:46789] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:23,784 INFO [RS:0;jenkins-hbase20:44055] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:23,784 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:13:23,784 INFO [RS:1;jenkins-hbase20:38771] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:23,784 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:13:23,785 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1022): About to register with Master. 2023-07-13 07:13:23,788 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:46789, startcode=1689232402346 2023-07-13 07:13:23,788 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:44055, startcode=1689232402206 2023-07-13 07:13:23,788 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:38771, startcode=1689232402287 2023-07-13 07:13:23,809 DEBUG [RS:0;jenkins-hbase20:44055] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:13:23,809 DEBUG [RS:1;jenkins-hbase20:38771] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:13:23,809 DEBUG [RS:2;jenkins-hbase20:46789] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-13 07:13:23,856 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-13 07:13:23,863 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43713, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:13:23,864 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42883, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:13:23,867 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50973, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:13:23,870 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:23,874 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:13:23,878 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689232433878 2023-07-13 07:13:23,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-13 07:13:23,886 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:13:23,886 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 07:13:23,887 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-13 07:13:23,887 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-13 07:13:23,895 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:13:23,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-13 07:13:23,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-13 07:13:23,910 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-13 07:13:23,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-13 07:13:23,911 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-13 07:13:23,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:23,920 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:13:23,921 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:13:23,921 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(2830): Master is not running yet 2023-07-13 07:13:23,922 WARN [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:13:23,922 WARN [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:13:23,922 WARN [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-13 07:13:23,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-13 07:13:23,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-13 07:13:23,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-13 07:13:23,930 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-13 07:13:23,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-13 07:13:23,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232403934,5,FailOnTimeoutGroup] 2023-07-13 07:13:23,934 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232403934,5,FailOnTimeoutGroup] 2023-07-13 07:13:23,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:23,935 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-13 07:13:23,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:23,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:23,959 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:23,960 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:23,961 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:23,992 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:23,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 07:13:23,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/info 2023-07-13 07:13:24,000 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 07:13:24,001 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,001 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 07:13:24,004 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:13:24,004 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 07:13:24,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 07:13:24,009 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/table 2023-07-13 07:13:24,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 07:13:24,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,013 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740 2023-07-13 07:13:24,014 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740 2023-07-13 07:13:24,018 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 07:13:24,021 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 07:13:24,027 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:46789, startcode=1689232402346 2023-07-13 07:13:24,027 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:44055, startcode=1689232402206 2023-07-13 07:13:24,028 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36645,1689232400946 with isa=jenkins-hbase20.apache.org/148.251.75.209:38771, startcode=1689232402287 2023-07-13 07:13:24,036 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:24,037 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59342554, jitterRate=-0.11572703719139099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 07:13:24,037 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 07:13:24,037 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 07:13:24,037 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 07:13:24,038 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 07:13:24,038 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 07:13:24,038 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 07:13:24,040 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,043 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 07:13:24,044 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 07:13:24,048 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,050 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:24,050 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42973 2023-07-13 07:13:24,050 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36645] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,050 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:13:24,053 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:24,053 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42973 2023-07-13 07:13:24,053 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:13:24,052 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:24,053 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42973 2023-07-13 07:13:24,053 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-13 07:13:24,061 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-13 07:13:24,061 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-13 07:13:24,061 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:13:24,064 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ZKUtil(162): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,064 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ZKUtil(162): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,064 WARN [RS:2;jenkins-hbase20:46789] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:13:24,065 INFO [RS:2;jenkins-hbase20:46789] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:13:24,065 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,067 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38771,1689232402287] 2023-07-13 07:13:24,068 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44055,1689232402206] 2023-07-13 07:13:24,068 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46789,1689232402346] 2023-07-13 07:13:24,065 WARN [RS:1;jenkins-hbase20:38771] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:13:24,073 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ZKUtil(162): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,073 WARN [RS:0;jenkins-hbase20:44055] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-13 07:13:24,073 INFO [RS:0;jenkins-hbase20:44055] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:13:24,073 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,071 INFO [RS:1;jenkins-hbase20:38771] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:13:24,075 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-13 07:13:24,092 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ZKUtil(162): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,092 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ZKUtil(162): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,092 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ZKUtil(162): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,092 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ZKUtil(162): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,092 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ZKUtil(162): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,092 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ZKUtil(162): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,093 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ZKUtil(162): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,093 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ZKUtil(162): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,093 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ZKUtil(162): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,100 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-13 07:13:24,105 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-13 07:13:24,108 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:13:24,108 DEBUG [RS:0;jenkins-hbase20:44055] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:13:24,108 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-13 07:13:24,118 INFO [RS:0;jenkins-hbase20:44055] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:13:24,118 INFO [RS:1;jenkins-hbase20:38771] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:13:24,118 INFO [RS:2;jenkins-hbase20:46789] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-13 07:13:24,145 INFO [RS:1;jenkins-hbase20:38771] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:13:24,145 INFO [RS:2;jenkins-hbase20:46789] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:13:24,145 INFO [RS:0;jenkins-hbase20:44055] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-13 07:13:24,150 INFO [RS:1;jenkins-hbase20:38771] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:13:24,150 INFO [RS:2;jenkins-hbase20:46789] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:13:24,150 INFO [RS:0;jenkins-hbase20:44055] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-13 07:13:24,151 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,151 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,151 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,153 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:13:24,153 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:13:24,153 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-13 07:13:24,161 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,161 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,161 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,161 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,162 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:13:24,163 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:2;jenkins-hbase20:46789] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,163 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:13:24,163 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-13 07:13:24,164 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:1;jenkins-hbase20:38771] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,164 DEBUG [RS:0;jenkins-hbase20:44055] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-13 07:13:24,171 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,172 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,172 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,173 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,188 INFO [RS:2;jenkins-hbase20:46789] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:13:24,188 INFO [RS:1;jenkins-hbase20:38771] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:13:24,188 INFO [RS:0;jenkins-hbase20:44055] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-13 07:13:24,194 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44055,1689232402206-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,194 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46789,1689232402346-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,194 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38771,1689232402287-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,221 INFO [RS:1;jenkins-hbase20:38771] regionserver.Replication(203): jenkins-hbase20.apache.org,38771,1689232402287 started 2023-07-13 07:13:24,222 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38771,1689232402287, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38771, sessionid=0x100852d5b890002 2023-07-13 07:13:24,222 INFO [RS:2;jenkins-hbase20:46789] regionserver.Replication(203): jenkins-hbase20.apache.org,46789,1689232402346 started 2023-07-13 07:13:24,222 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,46789,1689232402346, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46789, sessionid=0x100852d5b890003 2023-07-13 07:13:24,222 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:13:24,222 DEBUG [RS:2;jenkins-hbase20:46789] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,223 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46789,1689232402346' 2023-07-13 07:13:24,223 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:13:24,223 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:13:24,223 DEBUG [RS:1;jenkins-hbase20:38771] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,224 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38771,1689232402287' 2023-07-13 07:13:24,224 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:13:24,225 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:13:24,225 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:13:24,226 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:13:24,226 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:13:24,226 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:13:24,226 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:13:24,226 DEBUG [RS:2;jenkins-hbase20:46789] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:24,227 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46789,1689232402346' 2023-07-13 07:13:24,227 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:24,228 DEBUG [RS:2;jenkins-hbase20:46789] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:24,229 DEBUG [RS:2;jenkins-hbase20:46789] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:13:24,229 INFO [RS:2;jenkins-hbase20:46789] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:13:24,229 INFO [RS:2;jenkins-hbase20:46789] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:13:24,226 DEBUG [RS:1;jenkins-hbase20:38771] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,231 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38771,1689232402287' 2023-07-13 07:13:24,231 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:24,231 DEBUG [RS:1;jenkins-hbase20:38771] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:24,232 DEBUG [RS:1;jenkins-hbase20:38771] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:13:24,232 INFO [RS:1;jenkins-hbase20:38771] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:13:24,233 INFO [RS:1;jenkins-hbase20:38771] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:13:24,234 INFO [RS:0;jenkins-hbase20:44055] regionserver.Replication(203): jenkins-hbase20.apache.org,44055,1689232402206 started 2023-07-13 07:13:24,235 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44055,1689232402206, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44055, sessionid=0x100852d5b890001 2023-07-13 07:13:24,235 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-13 07:13:24,235 DEBUG [RS:0;jenkins-hbase20:44055] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,235 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44055,1689232402206' 2023-07-13 07:13:24,235 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-13 07:13:24,236 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-13 07:13:24,236 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-13 07:13:24,236 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-13 07:13:24,236 DEBUG [RS:0;jenkins-hbase20:44055] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:24,236 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44055,1689232402206' 2023-07-13 07:13:24,237 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:24,237 DEBUG [RS:0;jenkins-hbase20:44055] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:24,238 DEBUG [RS:0;jenkins-hbase20:44055] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-13 07:13:24,238 INFO [RS:0;jenkins-hbase20:44055] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-13 07:13:24,238 INFO [RS:0;jenkins-hbase20:44055] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-13 07:13:24,258 DEBUG [jenkins-hbase20:36645] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-13 07:13:24,263 DEBUG [jenkins-hbase20:36645] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:13:24,269 DEBUG [jenkins-hbase20:36645] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:13:24,269 DEBUG [jenkins-hbase20:36645] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:13:24,269 DEBUG [jenkins-hbase20:36645] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:13:24,269 DEBUG [jenkins-hbase20:36645] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:13:24,273 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38771,1689232402287, state=OPENING 2023-07-13 07:13:24,279 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-13 07:13:24,280 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:24,281 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 07:13:24,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:13:24,339 INFO [RS:2;jenkins-hbase20:46789] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46789%2C1689232402346, suffix=, logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,46789,1689232402346, archiveDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs, maxLogs=32 2023-07-13 07:13:24,339 INFO [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38771%2C1689232402287, suffix=, logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,38771,1689232402287, archiveDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs, maxLogs=32 2023-07-13 07:13:24,342 INFO [RS:0;jenkins-hbase20:44055] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44055%2C1689232402206, suffix=, logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,44055,1689232402206, archiveDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs, maxLogs=32 2023-07-13 07:13:24,374 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK] 2023-07-13 07:13:24,374 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK] 2023-07-13 07:13:24,375 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK] 2023-07-13 07:13:24,383 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK] 2023-07-13 07:13:24,384 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK] 2023-07-13 07:13:24,384 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK] 2023-07-13 07:13:24,385 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK] 2023-07-13 07:13:24,385 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK] 2023-07-13 07:13:24,385 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK] 2023-07-13 07:13:24,398 INFO [RS:0;jenkins-hbase20:44055] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,44055,1689232402206/jenkins-hbase20.apache.org%2C44055%2C1689232402206.1689232404345 2023-07-13 07:13:24,398 INFO [RS:2;jenkins-hbase20:46789] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,46789,1689232402346/jenkins-hbase20.apache.org%2C46789%2C1689232402346.1689232404345 2023-07-13 07:13:24,399 INFO [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,38771,1689232402287/jenkins-hbase20.apache.org%2C38771%2C1689232402287.1689232404345 2023-07-13 07:13:24,419 DEBUG [RS:0;jenkins-hbase20:44055] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK], DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK], DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK]] 2023-07-13 07:13:24,419 DEBUG [RS:2;jenkins-hbase20:46789] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK], DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK], DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK]] 2023-07-13 07:13:24,422 DEBUG [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK], DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK], DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK]] 2023-07-13 07:13:24,498 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:24,501 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:13:24,505 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:13:24,528 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-13 07:13:24,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-13 07:13:24,533 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38771%2C1689232402287.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,38771,1689232402287, archiveDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs, maxLogs=32 2023-07-13 07:13:24,565 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK] 2023-07-13 07:13:24,565 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK] 2023-07-13 07:13:24,568 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK] 2023-07-13 07:13:24,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/WALs/jenkins-hbase20.apache.org,38771,1689232402287/jenkins-hbase20.apache.org%2C38771%2C1689232402287.meta.1689232404535.meta 2023-07-13 07:13:24,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34309,DS-28513881-e91b-44a0-920c-e14aa49a7120,DISK], DatanodeInfoWithStorage[127.0.0.1:34655,DS-6f63f7fd-ca01-4c68-a00d-705d08e9d7c5,DISK], DatanodeInfoWithStorage[127.0.0.1:35905,DS-5847baa5-7bf4-4bb2-a1f3-284fd54bce37,DISK]] 2023-07-13 07:13:24,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:13:24,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-13 07:13:24,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:24,593 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-13 07:13:24,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-13 07:13:24,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-13 07:13:24,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-13 07:13:24,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:24,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-13 07:13:24,615 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-13 07:13:24,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-13 07:13:24,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/info 2023-07-13 07:13:24,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/info 2023-07-13 07:13:24,622 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-13 07:13:24,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-13 07:13:24,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:13:24,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/rep_barrier 2023-07-13 07:13:24,626 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-13 07:13:24,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-13 07:13:24,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/table 2023-07-13 07:13:24,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/table 2023-07-13 07:13:24,631 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-13 07:13:24,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:24,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740 2023-07-13 07:13:24,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740 2023-07-13 07:13:24,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-13 07:13:24,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-13 07:13:24,663 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60904635, jitterRate=-0.09245021641254425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-13 07:13:24,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-13 07:13:24,679 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689232404486 2023-07-13 07:13:24,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-13 07:13:24,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-13 07:13:24,704 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,38771,1689232402287, state=OPEN 2023-07-13 07:13:24,706 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-13 07:13:24,706 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-13 07:13:24,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-13 07:13:24,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,38771,1689232402287 in 421 msec 2023-07-13 07:13:24,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-13 07:13:24,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 635 msec 2023-07-13 07:13:24,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 953 msec 2023-07-13 07:13:24,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689232404726, completionTime=-1 2023-07-13 07:13:24,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-13 07:13:24,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-13 07:13:24,801 DEBUG [hconnection-0x61809ef1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:24,805 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:24,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-13 07:13:24,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689232464828 2023-07-13 07:13:24,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689232524828 2023-07-13 07:13:24,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 101 msec 2023-07-13 07:13:24,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36645,1689232400946-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36645,1689232400946-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,857 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36645,1689232400946-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36645, period=300000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,862 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-13 07:13:24,873 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-13 07:13:24,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-13 07:13:24,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:13:24,894 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-13 07:13:24,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:13:24,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:13:24,934 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/namespace/233b830218999a25681bb89c531844dd 2023-07-13 07:13:24,938 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/namespace/233b830218999a25681bb89c531844dd empty. 2023-07-13 07:13:24,939 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/namespace/233b830218999a25681bb89c531844dd 2023-07-13 07:13:24,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-13 07:13:25,016 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:25,018 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 233b830218999a25681bb89c531844dd, NAME => 'hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 233b830218999a25681bb89c531844dd, disabling compactions & flushes 2023-07-13 07:13:25,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. after waiting 0 ms 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,041 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,041 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 233b830218999a25681bb89c531844dd: 2023-07-13 07:13:25,046 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:13:25,062 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232405049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232405049"}]},"ts":"1689232405049"} 2023-07-13 07:13:25,124 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 07:13:25,126 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:13:25,130 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232405126"}]},"ts":"1689232405126"} 2023-07-13 07:13:25,136 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-13 07:13:25,140 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:13:25,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:13:25,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:13:25,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:13:25,141 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:13:25,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=233b830218999a25681bb89c531844dd, ASSIGN}] 2023-07-13 07:13:25,148 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=233b830218999a25681bb89c531844dd, ASSIGN 2023-07-13 07:13:25,150 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=233b830218999a25681bb89c531844dd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:13:25,303 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:13:25,304 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=233b830218999a25681bb89c531844dd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:25,304 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232405304"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232405304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232405304"}]},"ts":"1689232405304"} 2023-07-13 07:13:25,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 233b830218999a25681bb89c531844dd, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:13:25,474 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 233b830218999a25681bb89c531844dd, NAME => 'hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:13:25,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. service=AccessControlService 2023-07-13 07:13:25,476 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:25,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:25,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,481 INFO [StoreOpener-233b830218999a25681bb89c531844dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,484 DEBUG [StoreOpener-233b830218999a25681bb89c531844dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/info 2023-07-13 07:13:25,484 DEBUG [StoreOpener-233b830218999a25681bb89c531844dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/info 2023-07-13 07:13:25,484 INFO [StoreOpener-233b830218999a25681bb89c531844dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 233b830218999a25681bb89c531844dd columnFamilyName info 2023-07-13 07:13:25,486 INFO [StoreOpener-233b830218999a25681bb89c531844dd-1] regionserver.HStore(310): Store=233b830218999a25681bb89c531844dd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:25,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 233b830218999a25681bb89c531844dd 2023-07-13 07:13:25,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:25,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 233b830218999a25681bb89c531844dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74250702, jitterRate=0.10642167925834656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:25,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 233b830218999a25681bb89c531844dd: 2023-07-13 07:13:25,505 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd., pid=6, masterSystemTime=1689232405467 2023-07-13 07:13:25,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:13:25,511 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=233b830218999a25681bb89c531844dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:25,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689232405511"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232405511"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232405511"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232405511"}]},"ts":"1689232405511"} 2023-07-13 07:13:25,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-13 07:13:25,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 233b830218999a25681bb89c531844dd, server=jenkins-hbase20.apache.org,38771,1689232402287 in 204 msec 2023-07-13 07:13:25,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-13 07:13:25,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=233b830218999a25681bb89c531844dd, ASSIGN in 375 msec 2023-07-13 07:13:25,524 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:13:25,525 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232405524"}]},"ts":"1689232405524"} 2023-07-13 07:13:25,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-13 07:13:25,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:13:25,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 646 msec 2023-07-13 07:13:25,618 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-13 07:13:25,620 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:13:25,620 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:25,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-13 07:13:25,670 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:13:25,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-13 07:13:25,688 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-13 07:13:25,700 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-13 07:13:25,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-13 07:13:25,718 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-13 07:13:25,719 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-13 07:13:25,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.285sec 2023-07-13 07:13:25,723 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-13 07:13:25,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-13 07:13:25,725 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-13 07:13:25,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36645,1689232400946-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-13 07:13:25,728 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36645,1689232400946-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-13 07:13:25,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-13 07:13:25,754 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-13 07:13:25,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:13:25,761 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:13:25,763 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-13 07:13:25,765 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/acl/e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:25,766 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/acl/e203cb859309b901a2bd29bab56df89d empty. 2023-07-13 07:13:25,769 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/acl/e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:25,769 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-13 07:13:25,772 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:13:25,793 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:25,795 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e203cb859309b901a2bd29bab56df89d, NAME => 'hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e203cb859309b901a2bd29bab56df89d, disabling compactions & flushes 2023-07-13 07:13:25,816 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. after waiting 0 ms 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:25,816 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:25,816 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e203cb859309b901a2bd29bab56df89d: 2023-07-13 07:13:25,819 DEBUG [Listener at localhost.localdomain/36337] zookeeper.ReadOnlyZKClient(139): Connect 0x1ee8aab0 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:25,821 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:13:25,824 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232405824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232405824"}]},"ts":"1689232405824"} 2023-07-13 07:13:25,824 DEBUG [Listener at localhost.localdomain/36337] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51285dc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:25,828 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-13 07:13:25,830 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:13:25,831 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232405830"}]},"ts":"1689232405830"} 2023-07-13 07:13:25,835 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-13 07:13:25,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:13:25,847 DEBUG [hconnection-0x11d6354-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:25,848 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:13:25,848 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:13:25,848 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:13:25,848 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:13:25,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e203cb859309b901a2bd29bab56df89d, ASSIGN}] 2023-07-13 07:13:25,852 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e203cb859309b901a2bd29bab56df89d, ASSIGN 2023-07-13 07:13:25,855 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e203cb859309b901a2bd29bab56df89d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:13:25,863 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:25,866 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:13:25,866 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/test.cache.data in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop.tmp.dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop.log.dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-13 07:13:25,867 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/nfs.dump.dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-13 07:13:25,868 INFO [Listener at localhost.localdomain/36337] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-13 07:13:25,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:13:26,005 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:13:26,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e203cb859309b901a2bd29bab56df89d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:26,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232406006"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232406006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232406006"}]},"ts":"1689232406006"} 2023-07-13 07:13:26,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e203cb859309b901a2bd29bab56df89d, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:13:26,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:13:26,169 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:26,170 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:13:26,174 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:13:26,181 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:26,181 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e203cb859309b901a2bd29bab56df89d, NAME => 'hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:13:26,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. service=AccessControlService 2023-07-13 07:13:26,182 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:26,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:26,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,193 INFO [StoreOpener-e203cb859309b901a2bd29bab56df89d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,207 DEBUG [StoreOpener-e203cb859309b901a2bd29bab56df89d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/l 2023-07-13 07:13:26,207 DEBUG [StoreOpener-e203cb859309b901a2bd29bab56df89d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/l 2023-07-13 07:13:26,208 INFO [StoreOpener-e203cb859309b901a2bd29bab56df89d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e203cb859309b901a2bd29bab56df89d columnFamilyName l 2023-07-13 07:13:26,209 INFO [StoreOpener-e203cb859309b901a2bd29bab56df89d-1] regionserver.HStore(310): Store=e203cb859309b901a2bd29bab56df89d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:26,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e203cb859309b901a2bd29bab56df89d 2023-07-13 07:13:26,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:26,225 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e203cb859309b901a2bd29bab56df89d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63425282, jitterRate=-0.05488964915275574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:26,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e203cb859309b901a2bd29bab56df89d: 2023-07-13 07:13:26,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d., pid=11, masterSystemTime=1689232406169 2023-07-13 07:13:26,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:26,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:13:26,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e203cb859309b901a2bd29bab56df89d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:26,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689232406247"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232406247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232406247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232406247"}]},"ts":"1689232406247"} 2023-07-13 07:13:26,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-13 07:13:26,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e203cb859309b901a2bd29bab56df89d, server=jenkins-hbase20.apache.org,46789,1689232402346 in 243 msec 2023-07-13 07:13:26,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-13 07:13:26,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e203cb859309b901a2bd29bab56df89d, ASSIGN in 409 msec 2023-07-13 07:13:26,264 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:13:26,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232406264"}]},"ts":"1689232406264"} 2023-07-13 07:13:26,267 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-13 07:13:26,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:13:26,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 518 msec 2023-07-13 07:13:26,377 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-13 07:13:26,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-13 07:13:26,390 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-13 07:13:27,054 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:27,428 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:27,434 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_38143_jobhistory____x5pi08/webapp 2023-07-13 07:13:27,605 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-13 07:13:27,606 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-13 07:13:27,606 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:13:27,609 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:13:27,679 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:27,978 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:28,339 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-13 07:13:28,387 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:38143 2023-07-13 07:13:28,547 WARN [Listener at jenkins-hbase20.apache.org/32973] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:28,824 WARN [Listener at jenkins-hbase20.apache.org/32973] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:13:28,824 INFO [Listener at jenkins-hbase20.apache.org/32973] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:28,837 INFO [Listener at jenkins-hbase20.apache.org/32973] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_33163_cluster____n1jvr6/webapp 2023-07-13 07:13:28,920 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:13:28,920 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-13 07:13:28,921 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:13:28,922 INFO [Listener at jenkins-hbase20.apache.org/32973] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:13:28,939 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:29,146 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:29,251 INFO [Listener at jenkins-hbase20.apache.org/32973] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:29,260 INFO [Listener at jenkins-hbase20.apache.org/32973] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:33163 2023-07-13 07:13:30,130 WARN [Listener at jenkins-hbase20.apache.org/40403] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:30,160 WARN [Listener at jenkins-hbase20.apache.org/40403] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:13:30,161 INFO [Listener at jenkins-hbase20.apache.org/40403] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:30,169 INFO [Listener at jenkins-hbase20.apache.org/40403] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34269_node____g6b3uu/webapp 2023-07-13 07:13:30,214 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 07:13:30,214 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:13:30,214 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:13:30,215 INFO [Listener at jenkins-hbase20.apache.org/40403] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:13:30,223 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,241 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,307 INFO [Listener at jenkins-hbase20.apache.org/40403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,317 INFO [Listener at jenkins-hbase20.apache.org/40403] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34269 2023-07-13 07:13:30,369 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:13:30,505 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-13 07:13:30,520 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-13 07:13:30,522 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-13 07:13:30,721 WARN [Listener at jenkins-hbase20.apache.org/45007] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-13 07:13:30,730 WARN [Listener at jenkins-hbase20.apache.org/45007] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-13 07:13:30,731 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): jetty-6.1.26 2023-07-13 07:13:30,736 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_37231_node____.cnoyrm/webapp 2023-07-13 07:13:30,782 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-13 07:13:30,783 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-13 07:13:30,783 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-13 07:13:30,783 INFO [Listener at jenkins-hbase20.apache.org/45007] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-13 07:13:30,791 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,804 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,862 INFO [Listener at jenkins-hbase20.apache.org/45007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-13 07:13:30,866 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:37231 2023-07-13 07:13:30,883 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-13 07:13:30,884 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:13:30,955 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=169, AvailableMemoryMB=5113 2023-07-13 07:13:30,955 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-13 07:13:30,974 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-13 07:13:30,980 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-13 07:13:30,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:13:30,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:30,997 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:13:31,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-13 07:13:31,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:13:31,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:13:31,023 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,030 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,032 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 empty. 2023-07-13 07:13:31,036 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b empty. 2023-07-13 07:13:31,037 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,038 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 07:13:31,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:13:31,106 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-13 07:13:31,106 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:13:31,106 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-13 07:13:31,106 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 07:13:31,106 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-13 07:13:31,108 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:13:31,108 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-13 07:13:31,108 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 07:13:31,108 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-13 07:13:31,109 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:31,111 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 36c44809ad82f020d7489b7f0d848196, NAME => 'testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:31,111 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5dfae472eee5a3e0c37454a02733609b, NAME => 'testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:31,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:13:31,149 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:31,151 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 36c44809ad82f020d7489b7f0d848196, disabling compactions & flushes 2023-07-13 07:13:31,151 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,151 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:31,151 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5dfae472eee5a3e0c37454a02733609b, disabling compactions & flushes 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. after waiting 0 ms 2023-07-13 07:13:31,152 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. after waiting 0 ms 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,152 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5dfae472eee5a3e0c37454a02733609b: 2023-07-13 07:13:31,152 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,152 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,153 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 36c44809ad82f020d7489b7f0d848196: 2023-07-13 07:13:31,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:13:31,159 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232411159"}]},"ts":"1689232411159"} 2023-07-13 07:13:31,159 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232411159"}]},"ts":"1689232411159"} 2023-07-13 07:13:31,222 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:13:31,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:13:31,232 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232411231"}]},"ts":"1689232411231"} 2023-07-13 07:13:31,239 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-13 07:13:31,245 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:13:31,248 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:13:31,248 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:13:31,248 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:13:31,248 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:13:31,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, ASSIGN}] 2023-07-13 07:13:31,253 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, ASSIGN 2023-07-13 07:13:31,253 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, ASSIGN 2023-07-13 07:13:31,256 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44055,1689232402206; forceNewPlan=false, retain=false 2023-07-13 07:13:31,257 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:13:31,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:13:31,407 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:13:31,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5dfae472eee5a3e0c37454a02733609b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:31,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=36c44809ad82f020d7489b7f0d848196, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:31,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232411410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232411410"}]},"ts":"1689232411410"} 2023-07-13 07:13:31,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232411410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232411410"}]},"ts":"1689232411410"} 2023-07-13 07:13:31,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5dfae472eee5a3e0c37454a02733609b, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:13:31,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 36c44809ad82f020d7489b7f0d848196, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:13:31,571 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:31,571 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:13:31,577 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:13:31,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 36c44809ad82f020d7489b7f0d848196, NAME => 'testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:13:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. service=AccessControlService 2023-07-13 07:13:31,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:31,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,598 INFO [StoreOpener-36c44809ad82f020d7489b7f0d848196-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5dfae472eee5a3e0c37454a02733609b, NAME => 'testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:13:31,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. service=AccessControlService 2023-07-13 07:13:31,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:31,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:31,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,603 DEBUG [StoreOpener-36c44809ad82f020d7489b7f0d848196-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf 2023-07-13 07:13:31,603 DEBUG [StoreOpener-36c44809ad82f020d7489b7f0d848196-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf 2023-07-13 07:13:31,608 INFO [StoreOpener-36c44809ad82f020d7489b7f0d848196-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c44809ad82f020d7489b7f0d848196 columnFamilyName cf 2023-07-13 07:13:31,613 INFO [StoreOpener-36c44809ad82f020d7489b7f0d848196-1] regionserver.HStore(310): Store=36c44809ad82f020d7489b7f0d848196/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:31,615 INFO [StoreOpener-5dfae472eee5a3e0c37454a02733609b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,621 DEBUG [StoreOpener-5dfae472eee5a3e0c37454a02733609b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf 2023-07-13 07:13:31,622 DEBUG [StoreOpener-5dfae472eee5a3e0c37454a02733609b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf 2023-07-13 07:13:31,623 INFO [StoreOpener-5dfae472eee5a3e0c37454a02733609b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dfae472eee5a3e0c37454a02733609b columnFamilyName cf 2023-07-13 07:13:31,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:13:31,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:31,630 INFO [StoreOpener-5dfae472eee5a3e0c37454a02733609b-1] regionserver.HStore(310): Store=5dfae472eee5a3e0c37454a02733609b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:31,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:31,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:31,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 36c44809ad82f020d7489b7f0d848196; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72822581, jitterRate=0.08514101803302765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:31,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 36c44809ad82f020d7489b7f0d848196: 2023-07-13 07:13:31,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5dfae472eee5a3e0c37454a02733609b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64524680, jitterRate=-0.03850734233856201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:31,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5dfae472eee5a3e0c37454a02733609b: 2023-07-13 07:13:31,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196., pid=16, masterSystemTime=1689232411572 2023-07-13 07:13:31,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b., pid=15, masterSystemTime=1689232411571 2023-07-13 07:13:31,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:31,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=36c44809ad82f020d7489b7f0d848196, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:31,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411681"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232411681"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232411681"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232411681"}]},"ts":"1689232411681"} 2023-07-13 07:13:31,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5dfae472eee5a3e0c37454a02733609b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:31,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:31,692 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232411682"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232411682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232411682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232411682"}]},"ts":"1689232411682"} 2023-07-13 07:13:31,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-13 07:13:31,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 36c44809ad82f020d7489b7f0d848196, server=jenkins-hbase20.apache.org,46789,1689232402346 in 269 msec 2023-07-13 07:13:31,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, ASSIGN in 445 msec 2023-07-13 07:13:31,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-13 07:13:31,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5dfae472eee5a3e0c37454a02733609b, server=jenkins-hbase20.apache.org,44055,1689232402206 in 282 msec 2023-07-13 07:13:31,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-13 07:13:31,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, ASSIGN in 453 msec 2023-07-13 07:13:31,708 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:13:31,709 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232411708"}]},"ts":"1689232411708"} 2023-07-13 07:13:31,712 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-13 07:13:31,716 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:13:31,723 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-13 07:13:31,730 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:31,735 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:31,740 DEBUG [hconnection-0x4f386218-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:31,744 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-13 07:13:31,751 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:13:31,780 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:31,781 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:31,781 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:31,780 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:31,781 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:13:31,789 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:31,789 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:31,789 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:31,790 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:31,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 806 msec 2023-07-13 07:13:32,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-13 07:13:32,127 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-13 07:13:32,131 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 07:13:32,132 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:32,134 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:13:32,156 DEBUG [hconnection-0x11d6354-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,162 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,165 DEBUG [hconnection-0x11d6354-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,168 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232412183 (current time:1689232412183). 2023-07-13 07:13:32,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:13:32,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x2a634faa to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:32,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@774642b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:32,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,195 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a634faa to 127.0.0.1:61300 2023-07-13 07:13:32,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:32,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x32cccb86 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74ee99e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:32,211 DEBUG [hconnection-0x42059746-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,212 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,222 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32cccb86 to 127.0.0.1:61300 2023-07-13 07:13:32,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:32,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:13:32,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:13:32,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,265 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,267 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689233012267 2023-07-13 07:13:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 07:13:32,270 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:32,275 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:13:32,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-13 07:13:32,275 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:13:32,277 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:32,279 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689233012278 2023-07-13 07:13:32,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,320 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-13 07:13:32,320 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:32,322 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 07:13:32,322 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 07:13:32,323 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,323 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,325 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,326 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,326 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,326 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,327 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-13 07:13:32,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:32,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:32,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:32,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,332 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:32,332 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:32,332 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:32,332 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:32,334 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:32,332 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:32,335 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:32,335 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:32,335 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:32,336 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:32,342 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,342 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,343 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:32,343 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:32,344 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,344 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c134fa4[Count = 1] remaining members to acquire global barrier 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:32,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:13:32,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c134fa4[Count = 0] remaining members to acquire global barrier 2023-07-13 07:13:32,349 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 07:13:32,349 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,355 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:32,355 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:32,356 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:32,356 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:13:32,356 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,356 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:13:32,356 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:32,357 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:32,357 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:32,359 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:32,356 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:32,359 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:32,359 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:32,359 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. started... 2023-07-13 07:13:32,359 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:32,361 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. started... 2023-07-13 07:13:32,364 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36c44809ad82f020d7489b7f0d848196: 2023-07-13 07:13:32,364 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5dfae472eee5a3e0c37454a02733609b: 2023-07-13 07:13:32,366 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,366 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,373 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:32,373 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:32,377 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:32,379 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:13:32,379 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:13:32,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:32,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:32,383 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:13:32,433 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. completed. 2023-07-13 07:13:32,433 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,434 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. completed. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:32,434 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:32,434 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:32,435 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,435 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:32,435 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:13:32,436 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,436 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:32,436 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:32,436 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,436 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:32,436 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:32,437 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:32,437 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:13:32,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 07:13:32,447 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-13 07:13:32,447 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:13:32,447 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:13:32,447 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,447 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,450 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,451 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,452 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,453 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:32,454 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,454 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,467 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,468 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:32,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:32,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:32,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:32,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:13:32,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,583 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:32,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:32,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:32,586 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:13:32,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 07:13:32,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:32,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689232412267Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689232412488 (+221 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689232412488Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689232412489 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689232412505 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689232412536 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689232412604 (+68 ms) 2023-07-13 07:13:32,607 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:32,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 338 msec 2023-07-13 07:13:32,886 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:32,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:32,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:13:32,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44055] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:13:32,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:13:32,914 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-13 07:13:32,914 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:32,914 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:13:32,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232412933 (current time:1689232412933). 2023-07-13 07:13:32,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:13:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x0ad73f3c to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:32,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599849a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:32,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,947 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ad73f3c to 127.0.0.1:61300 2023-07-13 07:13:32,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:32,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x57ba5831 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:32,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64a7b325, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:32,961 DEBUG [hconnection-0x2d53467f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,965 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:32,978 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57ba5831 to 127.0.0.1:61300 2023-07-13 07:13:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-13 07:13:32,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:13:32,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,985 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,987 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689233012987 2023-07-13 07:13:32,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-13 07:13:32,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-13 07:13:32,989 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:13:32,989 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:13:32,991 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-13 07:13:32,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:32,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-13 07:13:32,995 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:32,998 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689233012998 2023-07-13 07:13:33,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-13 07:13:33,061 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-13 07:13:33,062 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:33,063 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-13 07:13:33,063 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-13 07:13:33,064 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,064 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,065 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,065 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,065 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,066 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,066 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,066 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,066 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:13:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:33,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:13:33,070 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,071 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:33,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,071 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-13 07:13:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-13 07:13:33,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:13:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:33,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:33,085 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:33,084 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:33,086 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-13 07:13:33,086 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-13 07:13:33,086 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-13 07:13:33,089 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,089 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,089 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:33,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:33,090 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:33,090 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,091 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,092 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:13:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a19ee63[Count = 1] remaining members to acquire global barrier 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:33,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:33,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-13 07:13:33,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a19ee63[Count = 0] remaining members to acquire global barrier 2023-07-13 07:13:33,097 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-13 07:13:33,097 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,105 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,105 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,105 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:33,106 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,106 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:33,106 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-13 07:13:33,106 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:33,106 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,107 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:13:33,106 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:13:33,110 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:33,110 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:33,111 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. started... 2023-07-13 07:13:33,111 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:33,111 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 36c44809ad82f020d7489b7f0d848196 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-13 07:13:33,114 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:33,120 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:33,120 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:33,120 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:33,120 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:33,120 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:33,120 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. started... 2023-07-13 07:13:33,137 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5dfae472eee5a3e0c37454a02733609b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-13 07:13:33,292 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:33,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:33,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:33,294 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:13:33,342 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4 2023-07-13 07:13:33,343 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7 2023-07-13 07:13:33,386 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/.tmp/cf/8d7c29136be644a088d3396b00611b9b 2023-07-13 07:13:33,387 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/.tmp/cf/f3ac0825818b4955919b287b5fe62f48 2023-07-13 07:13:33,399 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/.tmp/cf/f3ac0825818b4955919b287b5fe62f48 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48 2023-07-13 07:13:33,399 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/.tmp/cf/8d7c29136be644a088d3396b00611b9b as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b 2023-07-13 07:13:33,410 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48, entries=5, sequenceid=6, filesize=5.7 K 2023-07-13 07:13:33,412 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b, entries=45, sequenceid=6, filesize=12.5 K 2023-07-13 07:13:33,420 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5dfae472eee5a3e0c37454a02733609b in 284ms, sequenceid=6, compaction requested=false 2023-07-13 07:13:33,420 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 36c44809ad82f020d7489b7f0d848196 in 309ms, sequenceid=6, compaction requested=false 2023-07-13 07:13:33,421 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 07:13:33,421 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5dfae472eee5a3e0c37454a02733609b: 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 36c44809ad82f020d7489b7f0d848196: 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:33,424 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:33,425 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48] hfiles 2023-07-13 07:13:33,425 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b] hfiles 2023-07-13 07:13:33,425 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48 for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:13:33,425 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:13:33,479 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. completed. 2023-07-13 07:13:33,479 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:33,480 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:33,480 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:33,480 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,481 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:33,481 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:13:33,482 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. completed. 2023-07-13 07:13:33,482 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-13 07:13:33,482 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:13:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:33,482 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:33,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:33,484 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-13 07:13:33,484 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:33,484 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:33,484 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-13 07:13:33,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:33,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:13:33,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-13 07:13:33,492 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-13 07:13:33,492 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:13:33,492 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:13:33,492 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-13 07:13:33,492 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:33,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,496 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:33,496 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,497 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,497 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,500 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:33,500 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-13 07:13:33,500 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:33,514 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,514 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:33,514 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:33,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-13 07:13:33,513 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-13 07:13:33,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:33,514 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:33,514 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,515 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:33,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-13 07:13:33,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:13:33,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:33,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,515 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,516 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:33,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:33,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7] mob files 2023-07-13 07:13:33,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4 2023-07-13 07:13:33,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7 2023-07-13 07:13:33,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-13 07:13:33,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,594 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:33,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:33,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:33,600 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-13 07:13:33,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-13 07:13:33,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,627 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-13 07:13:33,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689232412987Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689232413533 (+546 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689232413533Loading Region manifests for snaptb0-testExportWithTargetName at 1689232413534 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689232413542 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689232413557 (+15 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689232413626 (+69 ms) 2023-07-13 07:13:33,630 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-13 07:13:33,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 642 msec 2023-07-13 07:13:34,101 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:34,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-13 07:13:34,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:13:34,104 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104 2023-07-13 07:13:34,104 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:42973, tgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104, rawTgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:34,156 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:34,157 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-441831911_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 07:13:34,157 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-13 07:13:34,220 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-13 07:13:34,316 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,317 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,318 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,318 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,319 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,319 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,320 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,404 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-1456828863058745675.jar 2023-07-13 07:13:34,405 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,405 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,406 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,406 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,407 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,407 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:34,408 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:13:34,408 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:13:34,409 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:13:34,409 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:13:34,410 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:13:34,410 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:13:34,410 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:13:34,411 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:13:34,411 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:13:34,412 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:13:34,414 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:34,415 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:34,415 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:34,416 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:34,416 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:34,416 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:34,417 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:35,650 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:13:35,656 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-13 07:13:35,666 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-13 07:13:36,034 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:13:36,036 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:13:36,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0001_000001 (auth:SIMPLE) 2023-07-13 07:13:37,095 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:13:41,390 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0001_000001 (auth:SIMPLE) 2023-07-13 07:13:43,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0001_000001 (auth:SIMPLE) 2023-07-13 07:13:46,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0001_000001 (auth:SIMPLE) 2023-07-13 07:13:48,426 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:13:48,429 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:13:48,444 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-13 07:13:48,444 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:13:48,445 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:13:48,445 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-13 07:13:48,446 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-13 07:13:48,446 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-13 07:13:48,446 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/testExportWithTargetName 2023-07-13 07:13:48,447 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-13 07:13:48,447 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232414104/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-13 07:13:48,461 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-13 07:13:48,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-07-13 07:13:48,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,483 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232428482"}]},"ts":"1689232428482"} 2023-07-13 07:13:48,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:13:48,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-13 07:13:48,486 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-13 07:13:48,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, UNASSIGN}] 2023-07-13 07:13:48,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, UNASSIGN 2023-07-13 07:13:48,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, UNASSIGN 2023-07-13 07:13:48,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5dfae472eee5a3e0c37454a02733609b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:48,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=36c44809ad82f020d7489b7f0d848196, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:48,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232428493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232428493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232428493"}]},"ts":"1689232428493"} 2023-07-13 07:13:48,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232428493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232428493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232428493"}]},"ts":"1689232428493"} 2023-07-13 07:13:48,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5dfae472eee5a3e0c37454a02733609b, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:13:48,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 36c44809ad82f020d7489b7f0d848196, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:13:48,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:13:48,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:48,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:48,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5dfae472eee5a3e0c37454a02733609b, disabling compactions & flushes 2023-07-13 07:13:48,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 36c44809ad82f020d7489b7f0d848196, disabling compactions & flushes 2023-07-13 07:13:48,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:48,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:48,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. after waiting 0 ms 2023-07-13 07:13:48,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:48,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:48,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:48,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. after waiting 0 ms 2023-07-13 07:13:48,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:13:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:13:48,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:13:48,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:13:48,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196. 2023-07-13 07:13:48,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b. 2023-07-13 07:13:48,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 36c44809ad82f020d7489b7f0d848196: 2023-07-13 07:13:48,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5dfae472eee5a3e0c37454a02733609b: 2023-07-13 07:13:48,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:48,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5dfae472eee5a3e0c37454a02733609b, regionState=CLOSED 2023-07-13 07:13:48,684 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232428683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232428683"}]},"ts":"1689232428683"} 2023-07-13 07:13:48,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:48,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=36c44809ad82f020d7489b7f0d848196, regionState=CLOSED 2023-07-13 07:13:48,685 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689232428684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232428684"}]},"ts":"1689232428684"} 2023-07-13 07:13:48,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-13 07:13:48,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5dfae472eee5a3e0c37454a02733609b, server=jenkins-hbase20.apache.org,44055,1689232402206 in 189 msec 2023-07-13 07:13:48,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-13 07:13:48,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 36c44809ad82f020d7489b7f0d848196, server=jenkins-hbase20.apache.org,46789,1689232402346 in 189 msec 2023-07-13 07:13:48,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5dfae472eee5a3e0c37454a02733609b, UNASSIGN in 200 msec 2023-07-13 07:13:48,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-13 07:13:48,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=36c44809ad82f020d7489b7f0d848196, UNASSIGN in 200 msec 2023-07-13 07:13:48,692 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232428692"}]},"ts":"1689232428692"} 2023-07-13 07:13:48,694 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-13 07:13:48,695 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-13 07:13:48,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-07-13 07:13:48,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-13 07:13:48,787 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-13 07:13:48,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-07-13 07:13:48,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-13 07:13:48,809 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,812 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-13 07:13:48,813 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:13:48,813 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:13:48,813 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:13:48,814 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-13 07:13:48,814 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:48,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:48,814 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:48,814 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:48,815 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:48,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:13:48,815 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:48,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:13:48,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:13:48,815 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:13:48,815 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:13:48,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-13 07:13:48,815 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:13:48,815 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-13 07:13:48,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 07:13:48,818 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/recovered.edits] 2023-07-13 07:13:48,818 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/recovered.edits] 2023-07-13 07:13:48,824 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/cf/8d7c29136be644a088d3396b00611b9b 2023-07-13 07:13:48,824 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/cf/f3ac0825818b4955919b287b5fe62f48 2023-07-13 07:13:48,829 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b/recovered.edits/9.seqid 2023-07-13 07:13:48,829 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196/recovered.edits/9.seqid 2023-07-13 07:13:48,831 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/5dfae472eee5a3e0c37454a02733609b 2023-07-13 07:13:48,831 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportWithTargetName/36c44809ad82f020d7489b7f0d848196 2023-07-13 07:13:48,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-13 07:13:48,831 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-13 07:13:48,832 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-13 07:13:48,836 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230713dd70ae080c84450abdfa6a4d13d63db4 2023-07-13 07:13:48,837 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307130b50360f9899463cb2bfb037b4ceead7 2023-07-13 07:13:48,837 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-13 07:13:48,840 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,859 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-13 07:13:48,862 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-13 07:13:48,863 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,863 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-13 07:13:48,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232428863"}]},"ts":"9223372036854775807"} 2023-07-13 07:13:48,864 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232428863"}]},"ts":"9223372036854775807"} 2023-07-13 07:13:48,866 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:13:48,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5dfae472eee5a3e0c37454a02733609b, NAME => 'testtb-testExportWithTargetName,,1689232410989.5dfae472eee5a3e0c37454a02733609b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 36c44809ad82f020d7489b7f0d848196, NAME => 'testtb-testExportWithTargetName,1,1689232410989.36c44809ad82f020d7489b7f0d848196.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:13:48,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-13 07:13:48,866 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232428866"}]},"ts":"9223372036854775807"} 2023-07-13 07:13:48,868 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-13 07:13:48,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-13 07:13:48,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-07-13 07:13:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-13 07:13:48,921 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-13 07:13:48,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-13 07:13:48,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-13 07:13:48,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-07-13 07:13:48,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-13 07:13:48,983 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 704) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:57648 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2047078181_1 at /127.0.0.1:38414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:35012 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:33383 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:39339 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:40403 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2047078181_1 at /127.0.0.1:34980 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:38436 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 149) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3599 (was 5113) 2023-07-13 07:13:48,984 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-13 07:13:49,005 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=172, AvailableMemoryMB=3598 2023-07-13 07:13:49,005 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-13 07:13:49,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:13:49,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:13:49,014 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:13:49,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-13 07:13:49,017 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:13:49,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:13:49,020 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,021 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 empty. 2023-07-13 07:13:49,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df empty. 2023-07-13 07:13:49,022 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,022 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,022 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 07:13:49,050 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 07:13:49,052 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7530d784beae2bb1ff1c1b0b8b437560, NAME => 'testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:49,052 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cf7bd9c8a05148f1fc422644f90ab1df, NAME => 'testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:13:49,092 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:49,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7530d784beae2bb1ff1c1b0b8b437560, disabling compactions & flushes 2023-07-13 07:13:49,099 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. after waiting 0 ms 2023-07-13 07:13:49,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,099 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7530d784beae2bb1ff1c1b0b8b437560: 2023-07-13 07:13:49,102 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:49,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cf7bd9c8a05148f1fc422644f90ab1df, disabling compactions & flushes 2023-07-13 07:13:49,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. after waiting 0 ms 2023-07-13 07:13:49,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,106 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,106 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cf7bd9c8a05148f1fc422644f90ab1df: 2023-07-13 07:13:49,109 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:13:49,110 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232429110"}]},"ts":"1689232429110"} 2023-07-13 07:13:49,110 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232429110"}]},"ts":"1689232429110"} 2023-07-13 07:13:49,113 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:13:49,114 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:13:49,114 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232429114"}]},"ts":"1689232429114"} 2023-07-13 07:13:49,115 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 07:13:49,117 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:13:49,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:13:49,119 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:13:49,119 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:13:49,119 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:13:49,119 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:13:49,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, ASSIGN}] 2023-07-13 07:13:49,122 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, ASSIGN 2023-07-13 07:13:49,122 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, ASSIGN 2023-07-13 07:13:49,123 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:13:49,123 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:13:49,274 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:13:49,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7530d784beae2bb1ff1c1b0b8b437560, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429277"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232429277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232429277"}]},"ts":"1689232429277"} 2023-07-13 07:13:49,278 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cf7bd9c8a05148f1fc422644f90ab1df, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,278 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429278"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232429278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232429278"}]},"ts":"1689232429278"} 2023-07-13 07:13:49,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 7530d784beae2bb1ff1c1b0b8b437560, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:13:49,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure cf7bd9c8a05148f1fc422644f90ab1df, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:13:49,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:13:49,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7530d784beae2bb1ff1c1b0b8b437560, NAME => 'testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:13:49,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. service=AccessControlService 2023-07-13 07:13:49,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:49,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:49,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf7bd9c8a05148f1fc422644f90ab1df, NAME => 'testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:13:49,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. service=AccessControlService 2023-07-13 07:13:49,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:13:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:13:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,444 INFO [StoreOpener-7530d784beae2bb1ff1c1b0b8b437560-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,445 INFO [StoreOpener-cf7bd9c8a05148f1fc422644f90ab1df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,445 DEBUG [StoreOpener-7530d784beae2bb1ff1c1b0b8b437560-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf 2023-07-13 07:13:49,446 DEBUG [StoreOpener-7530d784beae2bb1ff1c1b0b8b437560-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf 2023-07-13 07:13:49,446 INFO [StoreOpener-7530d784beae2bb1ff1c1b0b8b437560-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7530d784beae2bb1ff1c1b0b8b437560 columnFamilyName cf 2023-07-13 07:13:49,446 DEBUG [StoreOpener-cf7bd9c8a05148f1fc422644f90ab1df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf 2023-07-13 07:13:49,446 DEBUG [StoreOpener-cf7bd9c8a05148f1fc422644f90ab1df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf 2023-07-13 07:13:49,447 INFO [StoreOpener-cf7bd9c8a05148f1fc422644f90ab1df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf7bd9c8a05148f1fc422644f90ab1df columnFamilyName cf 2023-07-13 07:13:49,448 INFO [StoreOpener-cf7bd9c8a05148f1fc422644f90ab1df-1] regionserver.HStore(310): Store=cf7bd9c8a05148f1fc422644f90ab1df/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:49,448 INFO [StoreOpener-7530d784beae2bb1ff1c1b0b8b437560-1] regionserver.HStore(310): Store=7530d784beae2bb1ff1c1b0b8b437560/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:13:49,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:13:49,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:13:49,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:49,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:13:49,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7530d784beae2bb1ff1c1b0b8b437560; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62297017, jitterRate=-0.07170210778713226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:49,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cf7bd9c8a05148f1fc422644f90ab1df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70118801, jitterRate=0.04485155642032623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:13:49,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7530d784beae2bb1ff1c1b0b8b437560: 2023-07-13 07:13:49,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cf7bd9c8a05148f1fc422644f90ab1df: 2023-07-13 07:13:49,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df., pid=31, masterSystemTime=1689232429433 2023-07-13 07:13:49,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560., pid=30, masterSystemTime=1689232429432 2023-07-13 07:13:49,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7530d784beae2bb1ff1c1b0b8b437560, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429458"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232429458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232429458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232429458"}]},"ts":"1689232429458"} 2023-07-13 07:13:49,459 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cf7bd9c8a05148f1fc422644f90ab1df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,459 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232429459"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232429459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232429459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232429459"}]},"ts":"1689232429459"} 2023-07-13 07:13:49,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-13 07:13:49,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 7530d784beae2bb1ff1c1b0b8b437560, server=jenkins-hbase20.apache.org,46789,1689232402346 in 180 msec 2023-07-13 07:13:49,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-13 07:13:49,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, ASSIGN in 343 msec 2023-07-13 07:13:49,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure cf7bd9c8a05148f1fc422644f90ab1df, server=jenkins-hbase20.apache.org,38771,1689232402287 in 180 msec 2023-07-13 07:13:49,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-13 07:13:49,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, ASSIGN in 345 msec 2023-07-13 07:13:49,467 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:13:49,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232429467"}]},"ts":"1689232429467"} 2023-07-13 07:13:49,469 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 07:13:49,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:13:49,472 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-13 07:13:49,475 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:13:49,482 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:49,482 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:49,482 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:49,482 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:13:49,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:49,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:49,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:49,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:13:49,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 478 msec 2023-07-13 07:13:49,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-13 07:13:49,622 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-13 07:13:49,625 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 07:13:49,626 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,630 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:13:49,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:49,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232429651 (current time:1689232429651). 2023-07-13 07:13:49,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:13:49,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x70add157 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:49,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@562dcc19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:49,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:49,667 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:49,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70add157 to 127.0.0.1:61300 2023-07-13 07:13:49,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:49,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x0dedc7a6 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:49,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13d49825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:49,686 DEBUG [hconnection-0x2ba1c342-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:49,691 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:49,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:49,698 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dedc7a6 to 127.0.0.1:61300 2023-07-13 07:13:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:49,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:13:49,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:13:49,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:49,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:49,707 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:49,708 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233029708 2023-07-13 07:13:49,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:49,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 07:13:49,709 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:13:49,711 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:13:49,719 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:49,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:49,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-13 07:13:49,726 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:49,728 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233029728 2023-07-13 07:13:49,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,744 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-13 07:13:49,744 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:49,746 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 07:13:49,746 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:13:49,804 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,804 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,805 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,805 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,805 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,805 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,806 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,806 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,807 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,807 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,808 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:49,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:49,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:49,808 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:49,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,812 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:49,812 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:49,812 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:49,813 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:49,812 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:49,812 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:49,813 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:49,813 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:49,814 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:49,815 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:49,815 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:49,816 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:49,816 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:49,816 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:49,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:13:49,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:49,816 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:13:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,823 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4db6a506[Count = 1] remaining members to acquire global barrier 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:49,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:13:49,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4db6a506[Count = 0] remaining members to acquire global barrier 2023-07-13 07:13:49,827 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:13:49,827 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:49,828 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:49,828 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,828 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:49,829 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,829 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,829 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. started... 2023-07-13 07:13:49,829 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. started... 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:49,829 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:13:49,829 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,831 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf7bd9c8a05148f1fc422644f90ab1df: 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7530d784beae2bb1ff1c1b0b8b437560: 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:13:49,831 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:13:49,832 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:49,832 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:49,832 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:49,863 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. completed. 2023-07-13 07:13:49,863 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,863 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. completed. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:49,863 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:49,863 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:13:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:49,864 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:49,866 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:49,866 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:49,866 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,866 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:49,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:13:49,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:13:49,874 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-13 07:13:49,875 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:13:49,875 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:13:49,875 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,875 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,879 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:49,880 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,887 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:49,890 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,890 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,891 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,894 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,894 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,894 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,894 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:49,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:49,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:49,895 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:49,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:49,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:13:49,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,896 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:49,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:13:49,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 07:13:49,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,976 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-13 07:13:49,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689232429709Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689232429924 (+215 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689232429924Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689232429924Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689232429929 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689232429943 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689232429976 (+33 ms) 2023-07-13 07:13:49,979 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:49,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 268 msec 2023-07-13 07:13:50,016 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:50,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:13:50,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:13:50,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:13:50,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:13:50,029 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-13 07:13:50,029 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:50,029 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:13:50,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232430044 (current time:1689232430044). 2023-07-13 07:13:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:13:50,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x32ba8098 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ac58d0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:50,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:50,060 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:50,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32ba8098 to 127.0.0.1:61300 2023-07-13 07:13:50,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:50,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x7849a859 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:13:50,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@684a0aab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:13:50,086 DEBUG [hconnection-0x76db60fd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:50,087 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:50,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:13:50,100 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:13:50,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7849a859 to 127.0.0.1:61300 2023-07-13 07:13:50,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:13:50,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:13:50,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:13:50,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:50,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:50,108 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:50,113 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233030113 2023-07-13 07:13:50,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:13:50,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-13 07:13:50,117 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:13:50,118 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:13:50,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:50,120 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:13:50,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-13 07:13:50,125 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:50,130 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233030130 2023-07-13 07:13:50,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-13 07:13:50,187 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-13 07:13:50,187 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:50,189 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-13 07:13:50,189 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:13:50,189 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,189 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,191 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,191 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,192 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,192 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:13:50,193 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,193 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,194 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:50,194 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:50,194 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-13 07:13:50,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:13:50,194 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:50,194 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:50,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-13 07:13:50,194 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:50,200 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-13 07:13:50,200 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:13:50,200 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:50,200 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:50,202 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-13 07:13:50,203 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,204 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,204 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:50,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:50,204 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,204 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:50,204 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,205 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:50,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:50,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:50,205 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,205 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:13:50,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:50,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:13:50,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bfebd7b[Count = 1] remaining members to acquire global barrier 2023-07-13 07:13:50,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:50,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:50,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:50,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:50,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-13 07:13:50,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bfebd7b[Count = 0] remaining members to acquire global barrier 2023-07-13 07:13:50,212 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:13:50,212 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,216 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,216 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:50,216 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:50,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,217 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:13:50,217 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:50,217 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,217 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:13:50,217 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:13:50,218 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:50,218 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:50,218 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:50,218 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:50,219 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. started... 2023-07-13 07:13:50,219 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7530d784beae2bb1ff1c1b0b8b437560 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 07:13:50,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:13:50,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:50,219 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:13:50,220 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:50,220 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:50,220 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:50,222 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:13:50,224 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:50,224 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:13:50,224 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. started... 2023-07-13 07:13:50,225 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf7bd9c8a05148f1fc422644f90ab1df 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 07:13:50,257 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137 2023-07-13 07:13:50,271 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38 2023-07-13 07:13:50,293 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/.tmp/cf/5f80543b1bbc4d14ac85f49779ff3b7c 2023-07-13 07:13:50,301 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/.tmp/cf/5f80543b1bbc4d14ac85f49779ff3b7c as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c 2023-07-13 07:13:50,302 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/.tmp/cf/9b60d0790a1c4c9ab0342285e8df4642 2023-07-13 07:13:50,308 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 07:13:50,309 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7530d784beae2bb1ff1c1b0b8b437560 in 90ms, sequenceid=6, compaction requested=false 2023-07-13 07:13:50,309 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7530d784beae2bb1ff1c1b0b8b437560: 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c] hfiles 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:13:50,310 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/.tmp/cf/9b60d0790a1c4c9ab0342285e8df4642 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642 2023-07-13 07:13:50,320 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642, entries=46, sequenceid=6, filesize=12.7 K 2023-07-13 07:13:50,321 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for cf7bd9c8a05148f1fc422644f90ab1df in 96ms, sequenceid=6, compaction requested=false 2023-07-13 07:13:50,328 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf7bd9c8a05148f1fc422644f90ab1df: 2023-07-13 07:13:50,329 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:13:50,329 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:13:50,329 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642] hfiles 2023-07-13 07:13:50,329 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642 for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:13:50,337 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. completed. 2023-07-13 07:13:50,337 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:13:50,337 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:50,337 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:50,337 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,337 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:50,337 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:13:50,341 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:50,341 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,341 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:50,341 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:50,350 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. completed. 2023-07-13 07:13:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,350 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:13:50,350 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:13:50,350 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:13:50,350 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,350 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-13 07:13:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,350 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:13:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,354 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:13:50,354 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-13 07:13:50,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:13:50,354 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:50,354 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-13 07:13:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:13:50,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:13:50,359 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-13 07:13:50,359 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:13:50,359 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:13:50,359 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-13 07:13:50,359 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,361 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:13:50,362 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,362 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,363 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:13:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,365 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:13:50,365 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-13 07:13:50,366 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:13:50,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-13 07:13:50,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-13 07:13:50,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-13 07:13:50,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,384 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:13:50,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:13:50,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137] mob files 2023-07-13 07:13:50,384 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:13:50,383 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38 2023-07-13 07:13:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:13:50,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137 2023-07-13 07:13:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,386 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:13:50,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,386 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:13:50,386 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,386 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:13:50,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:13:50,419 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:50,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-13 07:13:50,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:13:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:13:50,422 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:13:50,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-13 07:13:50,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689232430114Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689232430420 (+306 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689232430420Loading Region manifests for snaptb0-testExportFileSystemState at 1689232430420Writing data manifest for snaptb0-testExportFileSystemState at 1689232430440 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689232430484 (+44 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689232430570 (+86 ms) 2023-07-13 07:13:50,574 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-13 07:13:50,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 458 msec 2023-07-13 07:13:50,728 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:13:50,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:13:50,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:13:50,730 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730 2023-07-13 07:13:50,730 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:42973, tgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730, rawTgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:50,786 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:13:50,787 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1482905462_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,787 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-13 07:13:50,819 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-13 07:13:50,870 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,871 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,871 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,871 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,872 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,872 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,872 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,946 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-6272617025618394272.jar 2023-07-13 07:13:50,947 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:13:50,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:13:50,951 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:13:50,952 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:13:50,953 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:13:50,953 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:13:50,954 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:13:50,955 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:13:50,955 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:13:50,956 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:13:50,956 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:13:50,957 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:50,957 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:50,958 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:50,959 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:50,959 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:13:50,960 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:50,961 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:13:51,959 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:13:51,962 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-13 07:13:51,966 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-13 07:13:52,900 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:13:52,900 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:13:52,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0001_000001 (auth:SIMPLE) 2023-07-13 07:13:53,900 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0002_000001 (auth:SIMPLE) 2023-07-13 07:13:54,281 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:13:58,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0002_000001 (auth:SIMPLE) 2023-07-13 07:14:00,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0002_000001 (auth:SIMPLE) 2023-07-13 07:14:03,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0002_000001 (auth:SIMPLE) 2023-07-13 07:14:04,198 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:14:04,199 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:14:04,207 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-13 07:14:04,207 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:14:04,207 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:14:04,208 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:14:04,208 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 07:14:04,208 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 07:14:04,208 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-13 07:14:04,209 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-13 07:14:04,209 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232430730/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-13 07:14:04,218 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-13 07:14:04,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-07-13 07:14:04,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:14:04,224 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232444223"}]},"ts":"1689232444223"} 2023-07-13 07:14:04,227 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 07:14:04,228 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-13 07:14:04,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, UNASSIGN}] 2023-07-13 07:14:04,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, UNASSIGN 2023-07-13 07:14:04,232 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, UNASSIGN 2023-07-13 07:14:04,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7530d784beae2bb1ff1c1b0b8b437560, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:04,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cf7bd9c8a05148f1fc422644f90ab1df, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:04,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232444233"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232444233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232444233"}]},"ts":"1689232444233"} 2023-07-13 07:14:04,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232444233"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232444233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232444233"}]},"ts":"1689232444233"} 2023-07-13 07:14:04,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 7530d784beae2bb1ff1c1b0b8b437560, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:04,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure cf7bd9c8a05148f1fc422644f90ab1df, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:04,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:14:04,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:14:04,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7530d784beae2bb1ff1c1b0b8b437560, disabling compactions & flushes 2023-07-13 07:14:04,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:14:04,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:14:04,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. after waiting 0 ms 2023-07-13 07:14:04,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:14:04,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:14:04,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cf7bd9c8a05148f1fc422644f90ab1df, disabling compactions & flushes 2023-07-13 07:14:04,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:14:04,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:14:04,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. after waiting 0 ms 2023-07-13 07:14:04,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:14:04,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:04,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:04,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:04,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df. 2023-07-13 07:14:04,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cf7bd9c8a05148f1fc422644f90ab1df: 2023-07-13 07:14:04,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560. 2023-07-13 07:14:04,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7530d784beae2bb1ff1c1b0b8b437560: 2023-07-13 07:14:04,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:14:04,417 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cf7bd9c8a05148f1fc422644f90ab1df, regionState=CLOSED 2023-07-13 07:14:04,417 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232444417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232444417"}]},"ts":"1689232444417"} 2023-07-13 07:14:04,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:14:04,418 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7530d784beae2bb1ff1c1b0b8b437560, regionState=CLOSED 2023-07-13 07:14:04,418 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689232444418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232444418"}]},"ts":"1689232444418"} 2023-07-13 07:14:04,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-13 07:14:04,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure cf7bd9c8a05148f1fc422644f90ab1df, server=jenkins-hbase20.apache.org,38771,1689232402287 in 183 msec 2023-07-13 07:14:04,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-13 07:14:04,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 7530d784beae2bb1ff1c1b0b8b437560, server=jenkins-hbase20.apache.org,46789,1689232402346 in 185 msec 2023-07-13 07:14:04,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf7bd9c8a05148f1fc422644f90ab1df, UNASSIGN in 192 msec 2023-07-13 07:14:04,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-13 07:14:04,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7530d784beae2bb1ff1c1b0b8b437560, UNASSIGN in 194 msec 2023-07-13 07:14:04,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232444425"}]},"ts":"1689232444425"} 2023-07-13 07:14:04,427 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 07:14:04,428 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-13 07:14:04,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-13 07:14:04,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-13 07:14:04,527 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-13 07:14:04,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-07-13 07:14:04,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-13 07:14:04,534 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,535 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-13 07:14:04,537 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,537 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,537 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,537 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:14:04,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:14:04,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:14:04,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-13 07:14:04,539 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:04,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 07:14:04,541 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:14:04,541 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:14:04,543 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/recovered.edits] 2023-07-13 07:14:04,543 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/recovered.edits] 2023-07-13 07:14:04,547 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/cf/9b60d0790a1c4c9ab0342285e8df4642 2023-07-13 07:14:04,548 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/cf/5f80543b1bbc4d14ac85f49779ff3b7c 2023-07-13 07:14:04,551 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df/recovered.edits/9.seqid 2023-07-13 07:14:04,552 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560/recovered.edits/9.seqid 2023-07-13 07:14:04,552 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/cf7bd9c8a05148f1fc422644f90ab1df 2023-07-13 07:14:04,552 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemState/7530d784beae2bb1ff1c1b0b8b437560 2023-07-13 07:14:04,552 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-13 07:14:04,553 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-13 07:14:04,554 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-13 07:14:04,558 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230713d97cbda3c7134850ba622e7481a7af38 2023-07-13 07:14:04,559 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230713f820696acfd44c55a7f7871082724137 2023-07-13 07:14:04,560 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-13 07:14:04,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,566 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-13 07:14:04,569 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-13 07:14:04,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-13 07:14:04,571 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232444571"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:04,571 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232444571"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:04,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:14:04,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7530d784beae2bb1ff1c1b0b8b437560, NAME => 'testtb-testExportFileSystemState,,1689232429007.7530d784beae2bb1ff1c1b0b8b437560.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cf7bd9c8a05148f1fc422644f90ab1df, NAME => 'testtb-testExportFileSystemState,1,1689232429007.cf7bd9c8a05148f1fc422644f90ab1df.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:14:04,574 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-13 07:14:04,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232444574"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:04,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-13 07:14:04,579 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-13 07:14:04,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-07-13 07:14:04,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-13 07:14:04,642 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-13 07:14:04,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-13 07:14:04,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-13 07:14:04,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-07-13 07:14:04,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-13 07:14:04,690 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 754) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:45007 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1691130491_1 at /127.0.0.1:50276 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:46038 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1391654189_17 at /127.0.0.1:44136 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1691130491_1 at /127.0.0.1:44120 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:34429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:50312 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 168) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=3355 (was 3598) 2023-07-13 07:14:04,690 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-13 07:14:04,713 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=172, AvailableMemoryMB=3354 2023-07-13 07:14:04,713 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-13 07:14:04,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:14:04,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:04,720 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:14:04,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-13 07:14:04,721 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:14:04,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:14:04,724 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:04,726 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 empty. 2023-07-13 07:14:04,726 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:04,727 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:04,727 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 empty. 2023-07-13 07:14:04,728 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:04,728 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 07:14:04,745 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-13 07:14:04,746 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e2943d636654d9e804a0156bc2b7f44, NAME => 'testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:04,746 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ba3a85f27a90b2202d655c5a62f28701, NAME => 'testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 8e2943d636654d9e804a0156bc2b7f44, disabling compactions & flushes 2023-07-13 07:14:04,771 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. after waiting 0 ms 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:04,771 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:04,771 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 8e2943d636654d9e804a0156bc2b7f44: 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ba3a85f27a90b2202d655c5a62f28701, disabling compactions & flushes 2023-07-13 07:14:04,773 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. after waiting 0 ms 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:04,773 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:04,773 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ba3a85f27a90b2202d655c5a62f28701: 2023-07-13 07:14:04,776 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:14:04,777 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232444777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232444777"}]},"ts":"1689232444777"} 2023-07-13 07:14:04,777 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232444777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232444777"}]},"ts":"1689232444777"} 2023-07-13 07:14:04,780 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:14:04,782 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:14:04,783 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232444783"}]},"ts":"1689232444783"} 2023-07-13 07:14:04,784 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-13 07:14:04,787 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:14:04,788 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:14:04,788 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:14:04,788 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:14:04,788 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:14:04,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, ASSIGN}] 2023-07-13 07:14:04,793 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, ASSIGN 2023-07-13 07:14:04,793 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, ASSIGN 2023-07-13 07:14:04,794 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:14:04,794 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:14:04,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:14:04,944 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:14:04,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8e2943d636654d9e804a0156bc2b7f44, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:04,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ba3a85f27a90b2202d655c5a62f28701, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:04,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232444948"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232444948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232444948"}]},"ts":"1689232444948"} 2023-07-13 07:14:04,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232444948"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232444948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232444948"}]},"ts":"1689232444948"} 2023-07-13 07:14:04,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 8e2943d636654d9e804a0156bc2b7f44, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:04,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ba3a85f27a90b2202d655c5a62f28701, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:05,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:14:05,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e2943d636654d9e804a0156bc2b7f44, NAME => 'testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:14:05,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. service=AccessControlService 2023-07-13 07:14:05,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:05,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:05,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba3a85f27a90b2202d655c5a62f28701, NAME => 'testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:14:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. service=AccessControlService 2023-07-13 07:14:05,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,110 INFO [StoreOpener-8e2943d636654d9e804a0156bc2b7f44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,111 INFO [StoreOpener-ba3a85f27a90b2202d655c5a62f28701-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,112 DEBUG [StoreOpener-8e2943d636654d9e804a0156bc2b7f44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf 2023-07-13 07:14:05,112 DEBUG [StoreOpener-8e2943d636654d9e804a0156bc2b7f44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf 2023-07-13 07:14:05,112 INFO [StoreOpener-8e2943d636654d9e804a0156bc2b7f44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e2943d636654d9e804a0156bc2b7f44 columnFamilyName cf 2023-07-13 07:14:05,113 DEBUG [StoreOpener-ba3a85f27a90b2202d655c5a62f28701-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf 2023-07-13 07:14:05,113 DEBUG [StoreOpener-ba3a85f27a90b2202d655c5a62f28701-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf 2023-07-13 07:14:05,113 INFO [StoreOpener-ba3a85f27a90b2202d655c5a62f28701-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3a85f27a90b2202d655c5a62f28701 columnFamilyName cf 2023-07-13 07:14:05,114 INFO [StoreOpener-8e2943d636654d9e804a0156bc2b7f44-1] regionserver.HStore(310): Store=8e2943d636654d9e804a0156bc2b7f44/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:05,114 INFO [StoreOpener-ba3a85f27a90b2202d655c5a62f28701-1] regionserver.HStore(310): Store=ba3a85f27a90b2202d655c5a62f28701/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:05,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:05,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:05,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:05,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ba3a85f27a90b2202d655c5a62f28701; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61872945, jitterRate=-0.07802127301692963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:05,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ba3a85f27a90b2202d655c5a62f28701: 2023-07-13 07:14:05,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701., pid=46, masterSystemTime=1689232445106 2023-07-13 07:14:05,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:05,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8e2943d636654d9e804a0156bc2b7f44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73018571, jitterRate=0.08806149661540985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:05,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8e2943d636654d9e804a0156bc2b7f44: 2023-07-13 07:14:05,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44., pid=45, masterSystemTime=1689232445104 2023-07-13 07:14:05,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ba3a85f27a90b2202d655c5a62f28701, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232445125"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232445125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232445125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232445125"}]},"ts":"1689232445125"} 2023-07-13 07:14:05,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,127 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8e2943d636654d9e804a0156bc2b7f44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,128 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232445127"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232445127"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232445127"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232445127"}]},"ts":"1689232445127"} 2023-07-13 07:14:05,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-13 07:14:05,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ba3a85f27a90b2202d655c5a62f28701, server=jenkins-hbase20.apache.org,38771,1689232402287 in 175 msec 2023-07-13 07:14:05,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, ASSIGN in 341 msec 2023-07-13 07:14:05,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-13 07:14:05,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 8e2943d636654d9e804a0156bc2b7f44, server=jenkins-hbase20.apache.org,46789,1689232402346 in 177 msec 2023-07-13 07:14:05,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-13 07:14:05,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, ASSIGN in 343 msec 2023-07-13 07:14:05,134 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:14:05,134 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232445134"}]},"ts":"1689232445134"} 2023-07-13 07:14:05,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-13 07:14:05,138 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:14:05,138 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-13 07:14:05,140 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:14:05,141 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:05,141 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:05,141 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:05,141 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:05,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:05,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:05,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:05,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:05,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 426 msec 2023-07-13 07:14:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-13 07:14:05,325 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-13 07:14:05,328 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 07:14:05,328 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,329 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:05,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232445343 (current time:1689232445343). 2023-07-13 07:14:05,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:05,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x54541dfb to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:05,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7e899, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:05,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,357 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54541dfb to 127.0.0.1:61300 2023-07-13 07:14:05,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:05,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x17625915 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@632d25c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:05,368 DEBUG [hconnection-0x5a27aa1b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,371 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,380 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17625915 to 127.0.0.1:61300 2023-07-13 07:14:05,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:05,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:14:05,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:05,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,387 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,388 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689233045388 2023-07-13 07:14:05,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 07:14:05,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,390 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:05,390 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:05,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:05,394 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-13 07:14:05,397 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:05,398 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689233045398 2023-07-13 07:14:05,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,416 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-13 07:14:05,416 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,418 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 07:14:05,418 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 07:14:05,418 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,418 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,419 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,419 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,419 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,419 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,420 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,420 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,420 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,420 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,421 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,421 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,421 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,421 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,423 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,428 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,428 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-13 07:14:05,428 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,428 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,428 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,428 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,429 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,429 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,429 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,429 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,432 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,432 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,432 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,433 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,434 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e813c91[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:14:05,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e813c91[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:05,436 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 07:14:05,436 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,439 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:05,440 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,440 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. started... 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:05,440 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,440 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:05,440 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,441 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba3a85f27a90b2202d655c5a62f28701: 2023-07-13 07:14:05,441 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. started... 2023-07-13 07:14:05,440 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e2943d636654d9e804a0156bc2b7f44: 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:05,442 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:05,444 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:05,444 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:05,445 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:05,469 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. completed. 2023-07-13 07:14:05,470 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. completed. 2023-07-13 07:14:05,470 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,470 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:05,470 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:05,471 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:05,471 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,471 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:05,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,471 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:05,473 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:05,473 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,473 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:05,473 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:05,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:14:05,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 07:14:05,480 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-13 07:14:05,480 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:05,480 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:05,480 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,480 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:05,490 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:14:05,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:05,492 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:05,494 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,494 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,496 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,496 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,498 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,499 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,499 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-13 07:14:05,505 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:05,506 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:14:05,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 07:14:05,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,573 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:05,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689232445388Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689232445523 (+135 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689232445523Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689232445523Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689232445529 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689232445544 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689232445572 (+28 ms) 2023-07-13 07:14:05,576 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:05,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 186 msec 2023-07-13 07:14:05,692 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:05,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:14:05,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:05,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:05,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38771] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:05,705 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-13 07:14:05,705 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,705 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:05,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232445733 (current time:1689232445733). 2023-07-13 07:14:05,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:05,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x4ea97811 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:05,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66fc485b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:05,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,751 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ea97811 to 127.0.0.1:61300 2023-07-13 07:14:05,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:05,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x015e42e1 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:05,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@432cb2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:05,762 DEBUG [hconnection-0x8f566-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,765 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:05,772 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:05,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x015e42e1 to 127.0.0.1:61300 2023-07-13 07:14:05,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:05,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-13 07:14:05,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:05,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,801 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,803 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689233045803 2023-07-13 07:14:05,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-13 07:14:05,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-13 07:14:05,805 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:05,811 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:05,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:05,813 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-13 07:14:05,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 19 msec 2023-07-13 07:14:05,819 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:05,820 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689233045820 2023-07-13 07:14:05,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-13 07:14:05,842 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-13 07:14:05,842 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,848 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-13 07:14:05,848 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-13 07:14:05,906 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,906 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,907 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,907 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,907 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,908 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-13 07:14:05,909 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:14:05,909 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,909 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,909 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,911 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:05,911 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,912 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-13 07:14:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-13 07:14:05,913 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-13 07:14:05,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:14:05,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:05,914 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,914 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,915 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,915 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,915 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,915 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,915 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,915 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,916 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,916 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c5c2d1[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:05,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:05,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-13 07:14:05,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c5c2d1[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:05,921 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-13 07:14:05,921 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,928 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,928 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,928 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:05,929 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:05,929 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-13 07:14:05,929 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:05,929 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:05,929 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:05,928 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:05,929 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:05,929 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. started... 2023-07-13 07:14:05,929 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:05,929 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8e2943d636654d9e804a0156bc2b7f44 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-13 07:14:05,930 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:05,930 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:05,930 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:05,931 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. started... 2023-07-13 07:14:05,931 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba3a85f27a90b2202d655c5a62f28701 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-13 07:14:05,932 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:05,932 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:05,932 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:05,961 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699 2023-07-13 07:14:05,961 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51 2023-07-13 07:14:05,973 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/.tmp/cf/6c8f09dad0bb4427a84a2daef19c2d2a 2023-07-13 07:14:05,975 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/.tmp/cf/6bdeef21aba44ba5a262e0c23d35f269 2023-07-13 07:14:05,981 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/.tmp/cf/6c8f09dad0bb4427a84a2daef19c2d2a as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a 2023-07-13 07:14:05,986 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/.tmp/cf/6bdeef21aba44ba5a262e0c23d35f269 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269 2023-07-13 07:14:05,990 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-13 07:14:05,991 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 8e2943d636654d9e804a0156bc2b7f44 in 62ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:05,991 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-13 07:14:05,991 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e2943d636654d9e804a0156bc2b7f44: 2023-07-13 07:14:05,992 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:14:05,992 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269, entries=48, sequenceid=6, filesize=12.9 K 2023-07-13 07:14:05,992 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:05,992 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a] hfiles 2023-07-13 07:14:05,992 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:14:05,993 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for ba3a85f27a90b2202d655c5a62f28701 in 62ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:05,994 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba3a85f27a90b2202d655c5a62f28701: 2023-07-13 07:14:05,995 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:14:05,995 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:05,995 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269] hfiles 2023-07-13 07:14:05,995 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269 for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:14:06,001 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. completed. 2023-07-13 07:14:06,001 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:06,001 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:06,002 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:06,002 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,002 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:06,002 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:06,003 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. completed. 2023-07-13 07:14:06,003 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:06,003 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:06,003 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:06,003 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:06,003 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,003 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:06,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:06,003 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:06,005 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,005 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-13 07:14:06,005 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:06,006 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,006 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-13 07:14:06,006 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:06,006 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-13 07:14:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:14:06,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-13 07:14:06,012 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-13 07:14:06,012 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:06,012 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:06,012 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-13 07:14:06,012 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:06,020 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,020 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,021 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,021 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:06,023 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-13 07:14:06,023 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,023 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:06,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:06,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-13 07:14:06,038 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:06,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-13 07:14:06,038 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,040 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,040 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:06,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:06,040 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,040 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:06,040 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:06,041 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,041 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51] mob files 2023-07-13 07:14:06,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699 2023-07-13 07:14:06,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51 2023-07-13 07:14:06,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-13 07:14:06,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,092 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-13 07:14:06,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,093 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689232445805Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689232446048 (+243 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689232446048Loading Region manifests for snaptb0-testConsecutiveExports at 1689232446048Writing data manifest for snaptb0-testConsecutiveExports at 1689232446052 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689232446063 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689232446092 (+29 ms) 2023-07-13 07:14:06,095 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-13 07:14:06,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 288 msec 2023-07-13 07:14:06,114 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:06,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-13 07:14:06,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:06,116 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116 2023-07-13 07:14:06,116 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:06,134 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:06,134 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@47cfeb3b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,134 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 07:14:06,143 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:06,154 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,154 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,155 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,155 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,156 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,156 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,157 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,222 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-1948757903365303097.jar 2023-07-13 07:14:06,223 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,223 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,224 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,224 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,225 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,225 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:06,225 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:14:06,226 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:14:06,226 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:14:06,227 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:14:06,227 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:14:06,228 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:14:06,228 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:14:06,229 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:14:06,229 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:14:06,230 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:14:06,231 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:06,231 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:06,232 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:06,232 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:06,233 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:06,233 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:06,234 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:06,641 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:14:06,643 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 07:14:06,646 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-13 07:14:09,212 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:09,212 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:09,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0002_000001 (auth:SIMPLE) 2023-07-13 07:14:09,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0003_000001 (auth:SIMPLE) 2023-07-13 07:14:09,990 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:14:13,861 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0003_000001 (auth:SIMPLE) 2023-07-13 07:14:16,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0003_000001 (auth:SIMPLE) 2023-07-13 07:14:18,362 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0003_000001 (auth:SIMPLE) 2023-07-13 07:14:19,834 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:14:19,834 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:14:19,838 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 07:14:19,838 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:14:19,839 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:14:19,839 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:14:19,841 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:14:19,841 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:14:19,841 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@45e8377 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:14:19,842 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:14:19,842 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:14:19,843 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:19,864 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:19,864 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@455f390e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:19,864 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-13 07:14:19,876 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-13 07:14:19,886 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,886 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,886 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,887 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,887 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,887 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,888 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,944 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-5377596152908827679.jar 2023-07-13 07:14:19,944 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,945 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,945 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,945 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,945 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,946 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:19,946 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:14:19,946 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:14:19,947 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:14:19,947 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:14:19,947 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:14:19,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:14:19,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:14:19,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:14:19,948 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:14:19,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:14:19,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:19,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:19,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:19,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:19,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:19,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:19,951 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:21,216 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:14:21,219 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-13 07:14:21,222 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-13 07:14:24,541 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:24,541 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:24,544 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0003_000001 (auth:SIMPLE) 2023-07-13 07:14:25,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0004_000001 (auth:SIMPLE) 2023-07-13 07:14:28,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0004_000001 (auth:SIMPLE) 2023-07-13 07:14:31,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0004_000001 (auth:SIMPLE) 2023-07-13 07:14:35,460 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:14:35,460 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:14:35,494 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-13 07:14:35,494 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:14:35,495 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:14:35,495 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:14:35,500 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:14:35,500 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:14:35,500 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@45e8377 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-13 07:14:35,500 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-13 07:14:35,500 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/local-export-1689232446116/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-13 07:14:35,521 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-13 07:14:35,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-07-13 07:14:35,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:35,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:14:35,535 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232475535"}]},"ts":"1689232475535"} 2023-07-13 07:14:35,544 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-13 07:14:35,545 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-13 07:14:35,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, UNASSIGN}] 2023-07-13 07:14:35,549 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, UNASSIGN 2023-07-13 07:14:35,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, UNASSIGN 2023-07-13 07:14:35,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8e2943d636654d9e804a0156bc2b7f44, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:35,551 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ba3a85f27a90b2202d655c5a62f28701, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:35,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232475550"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232475550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232475550"}]},"ts":"1689232475550"} 2023-07-13 07:14:35,551 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232475551"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232475551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232475551"}]},"ts":"1689232475551"} 2023-07-13 07:14:35,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 8e2943d636654d9e804a0156bc2b7f44, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:35,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ba3a85f27a90b2202d655c5a62f28701, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:35,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:14:35,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:35,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8e2943d636654d9e804a0156bc2b7f44, disabling compactions & flushes 2023-07-13 07:14:35,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:35,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:35,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. after waiting 0 ms 2023-07-13 07:14:35,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:35,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:35,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ba3a85f27a90b2202d655c5a62f28701, disabling compactions & flushes 2023-07-13 07:14:35,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:35,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:35,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. after waiting 0 ms 2023-07-13 07:14:35,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:35,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:14:35,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:35,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:35,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701. 2023-07-13 07:14:35,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:35,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ba3a85f27a90b2202d655c5a62f28701: 2023-07-13 07:14:35,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:35,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44. 2023-07-13 07:14:35,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8e2943d636654d9e804a0156bc2b7f44: 2023-07-13 07:14:35,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:35,862 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ba3a85f27a90b2202d655c5a62f28701, regionState=CLOSED 2023-07-13 07:14:35,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:35,862 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232475862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232475862"}]},"ts":"1689232475862"} 2023-07-13 07:14:35,871 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=8e2943d636654d9e804a0156bc2b7f44, regionState=CLOSED 2023-07-13 07:14:35,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689232475871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232475871"}]},"ts":"1689232475871"} 2023-07-13 07:14:35,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-13 07:14:35,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ba3a85f27a90b2202d655c5a62f28701, server=jenkins-hbase20.apache.org,38771,1689232402287 in 310 msec 2023-07-13 07:14:35,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ba3a85f27a90b2202d655c5a62f28701, UNASSIGN in 328 msec 2023-07-13 07:14:35,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-13 07:14:35,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 8e2943d636654d9e804a0156bc2b7f44, server=jenkins-hbase20.apache.org,46789,1689232402346 in 321 msec 2023-07-13 07:14:35,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-13 07:14:35,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8e2943d636654d9e804a0156bc2b7f44, UNASSIGN in 332 msec 2023-07-13 07:14:35,881 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232475881"}]},"ts":"1689232475881"} 2023-07-13 07:14:35,882 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-13 07:14:35,883 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-13 07:14:35,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 362 msec 2023-07-13 07:14:36,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-13 07:14:36,132 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-13 07:14:36,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-07-13 07:14:36,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,138 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,139 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-13 07:14:36,148 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-13 07:14:36,150 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,150 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,150 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,150 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:14:36,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:14:36,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:14:36,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-13 07:14:36,156 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,156 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-13 07:14:36,157 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 07:14:36,167 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:36,170 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/recovered.edits] 2023-07-13 07:14:36,171 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:36,176 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/cf/6c8f09dad0bb4427a84a2daef19c2d2a 2023-07-13 07:14:36,178 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/recovered.edits] 2023-07-13 07:14:36,181 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44/recovered.edits/9.seqid 2023-07-13 07:14:36,182 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/8e2943d636654d9e804a0156bc2b7f44 2023-07-13 07:14:36,185 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/cf/6bdeef21aba44ba5a262e0c23d35f269 2023-07-13 07:14:36,194 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701/recovered.edits/9.seqid 2023-07-13 07:14:36,195 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testConsecutiveExports/ba3a85f27a90b2202d655c5a62f28701 2023-07-13 07:14:36,195 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-13 07:14:36,196 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-13 07:14:36,197 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-13 07:14:36,201 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307139f94fb2650894eb9a2999c6d0e243699 2023-07-13 07:14:36,203 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230713cf293786ff0b40269fd7574ef2dc4e51 2023-07-13 07:14:36,203 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-13 07:14:36,206 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,208 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-13 07:14:36,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-13 07:14:36,214 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,214 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-13 07:14:36,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232476215"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:36,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232476215"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:36,221 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:14:36,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8e2943d636654d9e804a0156bc2b7f44, NAME => 'testtb-testConsecutiveExports,,1689232444715.8e2943d636654d9e804a0156bc2b7f44.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ba3a85f27a90b2202d655c5a62f28701, NAME => 'testtb-testConsecutiveExports,1,1689232444715.ba3a85f27a90b2202d655c5a62f28701.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:14:36,221 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-13 07:14:36,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232476221"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:36,229 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-13 07:14:36,231 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-13 07:14:36,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 99 msec 2023-07-13 07:14:36,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-13 07:14:36,261 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-13 07:14:36,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-13 07:14:36,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-13 07:14:36,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-07-13 07:14:36,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-13 07:14:36,344 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 766), OpenFileDescriptor=901 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=3127 (was 3354) 2023-07-13 07:14:36,344 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-13 07:14:36,373 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=173, AvailableMemoryMB=3128 2023-07-13 07:14:36,373 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-13 07:14:36,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:14:36,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:36,381 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:14:36,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-13 07:14:36,382 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:14:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:14:36,385 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,385 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,386 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 empty. 2023-07-13 07:14:36,386 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 empty. 2023-07-13 07:14:36,386 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,386 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 07:14:36,402 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-13 07:14:36,410 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 517e3b152e309e14e11d0b6891728406, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:36,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1f7569b6bd6e3a2fd227cdf7ed049fa8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:36,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:36,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 1f7569b6bd6e3a2fd227cdf7ed049fa8, disabling compactions & flushes 2023-07-13 07:14:36,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. after waiting 0 ms 2023-07-13 07:14:36,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 1f7569b6bd6e3a2fd227cdf7ed049fa8: 2023-07-13 07:14:36,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:36,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 517e3b152e309e14e11d0b6891728406, disabling compactions & flushes 2023-07-13 07:14:36,484 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. after waiting 0 ms 2023-07-13 07:14:36,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:14:36,484 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 517e3b152e309e14e11d0b6891728406: 2023-07-13 07:14:36,488 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:14:36,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232476489"}]},"ts":"1689232476489"} 2023-07-13 07:14:36,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232476489"}]},"ts":"1689232476489"} 2023-07-13 07:14:36,497 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:14:36,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:14:36,501 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232476501"}]},"ts":"1689232476501"} 2023-07-13 07:14:36,503 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-13 07:14:36,505 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:14:36,506 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:14:36,506 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:14:36,506 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:14:36,506 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:14:36,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, ASSIGN}] 2023-07-13 07:14:36,510 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, ASSIGN 2023-07-13 07:14:36,510 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, ASSIGN 2023-07-13 07:14:36,512 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:14:36,512 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:14:36,662 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:14:36,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1f7569b6bd6e3a2fd227cdf7ed049fa8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:36,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=517e3b152e309e14e11d0b6891728406, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:36,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476665"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232476665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232476665"}]},"ts":"1689232476665"} 2023-07-13 07:14:36,666 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476665"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232476665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232476665"}]},"ts":"1689232476665"} 2023-07-13 07:14:36,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 1f7569b6bd6e3a2fd227cdf7ed049fa8, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:36,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 517e3b152e309e14e11d0b6891728406, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:36,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:14:36,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f7569b6bd6e3a2fd227cdf7ed049fa8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:14:36,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. service=AccessControlService 2023-07-13 07:14:36,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:36,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:36,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 517e3b152e309e14e11d0b6891728406, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:14:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. service=AccessControlService 2023-07-13 07:14:36,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,827 INFO [StoreOpener-1f7569b6bd6e3a2fd227cdf7ed049fa8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,828 DEBUG [StoreOpener-1f7569b6bd6e3a2fd227cdf7ed049fa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf 2023-07-13 07:14:36,828 INFO [StoreOpener-517e3b152e309e14e11d0b6891728406-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,828 DEBUG [StoreOpener-1f7569b6bd6e3a2fd227cdf7ed049fa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf 2023-07-13 07:14:36,829 INFO [StoreOpener-1f7569b6bd6e3a2fd227cdf7ed049fa8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f7569b6bd6e3a2fd227cdf7ed049fa8 columnFamilyName cf 2023-07-13 07:14:36,830 DEBUG [StoreOpener-517e3b152e309e14e11d0b6891728406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf 2023-07-13 07:14:36,830 DEBUG [StoreOpener-517e3b152e309e14e11d0b6891728406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf 2023-07-13 07:14:36,830 INFO [StoreOpener-517e3b152e309e14e11d0b6891728406-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 517e3b152e309e14e11d0b6891728406 columnFamilyName cf 2023-07-13 07:14:36,831 INFO [StoreOpener-1f7569b6bd6e3a2fd227cdf7ed049fa8-1] regionserver.HStore(310): Store=1f7569b6bd6e3a2fd227cdf7ed049fa8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:36,832 INFO [StoreOpener-517e3b152e309e14e11d0b6891728406-1] regionserver.HStore(310): Store=517e3b152e309e14e11d0b6891728406/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:36,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:36,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:36,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:36,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1f7569b6bd6e3a2fd227cdf7ed049fa8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68119579, jitterRate=0.015060827136039734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1f7569b6bd6e3a2fd227cdf7ed049fa8: 2023-07-13 07:14:36,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8., pid=60, masterSystemTime=1689232476820 2023-07-13 07:14:36,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:36,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:36,844 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1f7569b6bd6e3a2fd227cdf7ed049fa8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:36,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 517e3b152e309e14e11d0b6891728406; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61654870, jitterRate=-0.08127084374427795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:36,844 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476844"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232476844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232476844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232476844"}]},"ts":"1689232476844"} 2023-07-13 07:14:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 517e3b152e309e14e11d0b6891728406: 2023-07-13 07:14:36,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406., pid=61, masterSystemTime=1689232476822 2023-07-13 07:14:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,848 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=517e3b152e309e14e11d0b6891728406, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:36,848 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232476848"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232476848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232476848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232476848"}]},"ts":"1689232476848"} 2023-07-13 07:14:36,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-13 07:14:36,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 1f7569b6bd6e3a2fd227cdf7ed049fa8, server=jenkins-hbase20.apache.org,46789,1689232402346 in 179 msec 2023-07-13 07:14:36,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, ASSIGN in 343 msec 2023-07-13 07:14:36,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-13 07:14:36,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 517e3b152e309e14e11d0b6891728406, server=jenkins-hbase20.apache.org,38771,1689232402287 in 180 msec 2023-07-13 07:14:36,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-13 07:14:36,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, ASSIGN in 345 msec 2023-07-13 07:14:36,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:14:36,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232476858"}]},"ts":"1689232476858"} 2023-07-13 07:14:36,860 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-13 07:14:36,867 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:14:36,867 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-13 07:14:36,870 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:14:36,881 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,881 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,881 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,881 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:36,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:36,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:36,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:36,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:36,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 509 msec 2023-07-13 07:14:36,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-13 07:14:36,987 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-13 07:14:36,990 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:36,990 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:36,994 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:37,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232477016 (current time:1689232477016). 2023-07-13 07:14:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:37,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x34399c32 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bffeda7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:37,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,033 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34399c32 to 127.0.0.1:61300 2023-07-13 07:14:37,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:37,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x30cb1326 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:37,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@486bc101, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:37,055 DEBUG [hconnection-0xcbd8f7e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,056 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,071 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30cb1326 to 127.0.0.1:61300 2023-07-13 07:14:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:14:37,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:37,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,084 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,086 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689233077086 2023-07-13 07:14:37,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,087 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:37,087 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:37,094 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:37,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-13 07:14:37,098 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:37,099 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689233077099 2023-07-13 07:14:37,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,122 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:14:37,122 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,124 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 07:14:37,124 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 07:14:37,125 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,125 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,126 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,126 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,127 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,127 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,128 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,128 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,128 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,128 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,130 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,131 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,136 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,139 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,139 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,140 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,140 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,140 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,140 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,140 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,141 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d23d9fa[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,145 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,145 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,145 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,152 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,152 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,152 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:14:37,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d23d9fa[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:37,160 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 07:14:37,160 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,161 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,162 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,162 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,162 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:37,162 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:37,164 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:37,164 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,164 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:37,164 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:37,164 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,164 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:37,166 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:37,168 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:37,168 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:37,168 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. started... 2023-07-13 07:14:37,169 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 517e3b152e309e14e11d0b6891728406: 2023-07-13 07:14:37,169 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,169 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:37,169 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:37,168 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:37,170 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. started... 2023-07-13 07:14:37,168 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:37,173 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:37,178 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f7569b6bd6e3a2fd227cdf7ed049fa8: 2023-07-13 07:14:37,179 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,182 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:37,182 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:37,187 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:37,189 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:37,242 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. completed. 2023-07-13 07:14:37,242 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:37,242 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. completed. 2023-07-13 07:14:37,242 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:37,242 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:37,243 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:37,244 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,244 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,244 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:37,244 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:37,244 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:37,245 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:37,245 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:37,249 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:14:37,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 07:14:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:37,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 07:14:37,274 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 07:14:37,274 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:37,274 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:37,274 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,274 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,276 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,281 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,281 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,283 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,285 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,286 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,286 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,297 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,297 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,297 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,297 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,296 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:37,296 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:37,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:37,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:14:37,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:37,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,389 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:37,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:37,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:37,390 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:14:37,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 07:14:37,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,440 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689232477086Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689232477329 (+243 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232477329Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232477329Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232477352 (+23 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689232477382 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689232477439 (+57 ms) 2023-07-13 07:14:37,443 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:37,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 351 msec 2023-07-13 07:14:37,690 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:37,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:37,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:37,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:37,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:37,722 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,722 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:37,722 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:37,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232477756 (current time:1689232477756). 2023-07-13 07:14:37,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:37,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x5ec652e9 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:37,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67877b15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:37,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,782 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ec652e9 to 127.0.0.1:61300 2023-07-13 07:14:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x5cb79ff1 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:37,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@308adf94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:37,818 DEBUG [hconnection-0x6c095543-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,824 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:37,835 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cb79ff1 to 127.0.0.1:61300 2023-07-13 07:14:37,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:37,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-13 07:14:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,847 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,848 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689233077848 2023-07-13 07:14:37,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-13 07:14:37,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,848 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:37,850 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:37,850 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-13 07:14:37,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:37,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-13 07:14:37,854 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:37,855 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689233077855 2023-07-13 07:14:37,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,891 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:14:37,892 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,893 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-13 07:14:37,893 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-13 07:14:37,894 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,894 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,895 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,895 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:37,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,896 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,896 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,896 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,896 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,897 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-13 07:14:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-13 07:14:37,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,898 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,898 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,898 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,898 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,905 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,905 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,905 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,906 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,906 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,906 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,906 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-13 07:14:37,906 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:37,909 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-13 07:14:37,909 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-13 07:14:37,909 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-13 07:14:37,910 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,910 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,911 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,911 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,911 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,911 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,912 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,912 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,913 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,913 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,913 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:37,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:14:37,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6328b640[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:37,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:37,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-13 07:14:37,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6328b640[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:37,922 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-13 07:14:37,922 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,927 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:37,928 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,928 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:37,928 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:37,928 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-13 07:14:37,928 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:37,928 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:37,929 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:37,929 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:37,929 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:37,934 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:37,939 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:37,938 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:37,938 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:37,939 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:37,939 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:37,939 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. started... 2023-07-13 07:14:37,939 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. started... 2023-07-13 07:14:37,939 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 517e3b152e309e14e11d0b6891728406 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-13 07:14:37,939 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1f7569b6bd6e3a2fd227cdf7ed049fa8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-13 07:14:37,950 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:37,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:37,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:37,952 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:38,044 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed 2023-07-13 07:14:38,095 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb 2023-07-13 07:14:38,115 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/.tmp/cf/52be9d8091d44f8c9585e7a450ebd57a 2023-07-13 07:14:38,121 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/.tmp/cf/52be9d8091d44f8c9585e7a450ebd57a as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a 2023-07-13 07:14:38,144 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/.tmp/cf/07db5b03179149c7a8184306e24b4ac6 2023-07-13 07:14:38,144 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a, entries=5, sequenceid=6, filesize=5.8 K 2023-07-13 07:14:38,145 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 517e3b152e309e14e11d0b6891728406 in 206ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:38,145 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-13 07:14:38,146 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 517e3b152e309e14e11d0b6891728406: 2023-07-13 07:14:38,147 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,147 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:38,147 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a] hfiles 2023-07-13 07:14:38,147 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,152 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:38,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:38,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:38,154 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:14:38,167 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/.tmp/cf/07db5b03179149c7a8184306e24b4ac6 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6 2023-07-13 07:14:38,177 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6, entries=45, sequenceid=6, filesize=13.2 K 2023-07-13 07:14:38,193 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 1f7569b6bd6e3a2fd227cdf7ed049fa8 in 254ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:38,195 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f7569b6bd6e3a2fd227cdf7ed049fa8: 2023-07-13 07:14:38,196 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,196 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:38,196 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6] hfiles 2023-07-13 07:14:38,196 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,210 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. completed. 2023-07-13 07:14:38,210 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:38,212 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,212 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:38,212 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:38,212 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:14:38,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-13 07:14:38,248 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. completed. 2023-07-13 07:14:38,248 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:38,248 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:38,248 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:38,248 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,248 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-13 07:14:38,248 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:38,250 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-13 07:14:38,250 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,250 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:38,251 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-13 07:14:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:38,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-13 07:14:38,259 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-13 07:14:38,259 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:38,259 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:38,259 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,259 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:38,261 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,261 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,261 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,262 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,262 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,263 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,264 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,265 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,266 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,267 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:38,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:38,269 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:38,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:38,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,269 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,270 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,272 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,272 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,272 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:38,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:38,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:38,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed] mob files 2023-07-13 07:14:38,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb 2023-07-13 07:14:38,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed 2023-07-13 07:14:38,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-13 07:14:38,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-13 07:14:38,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,429 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:38,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689232477848Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689232478307 (+459 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689232478307Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689232478307Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689232478312 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689232478339 (+27 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689232478428 (+89 ms) 2023-07-13 07:14:38,433 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-13 07:14:38,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 584 msec 2023-07-13 07:14:38,454 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-13 07:14:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:38,493 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:14:38,497 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:14:38,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38771] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:14:38,501 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:14:38,505 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:14:38,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44055] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:14:38,506 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-13 07:14:38,510 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-13 07:14:38,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-13 07:14:38,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-13 07:14:38,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:38,522 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:14:38,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-13 07:14:38,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:14:38,527 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:14:38,533 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,534 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,534 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 empty. 2023-07-13 07:14:38,535 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e empty. 2023-07-13 07:14:38,537 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,538 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,538 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 07:14:38,565 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-13 07:14:38,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8059ae7e77b5de84b7fb616b3d36992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:38,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 084f5b0cf159b57f8597f573446d343e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 084f5b0cf159b57f8597f573446d343e, disabling compactions & flushes 2023-07-13 07:14:38,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. after waiting 0 ms 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 084f5b0cf159b57f8597f573446d343e: 2023-07-13 07:14:38,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:38,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e8059ae7e77b5de84b7fb616b3d36992, disabling compactions & flushes 2023-07-13 07:14:38,593 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. after waiting 0 ms 2023-07-13 07:14:38,593 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e8059ae7e77b5de84b7fb616b3d36992: 2023-07-13 07:14:38,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:14:38,611 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232478610"}]},"ts":"1689232478610"} 2023-07-13 07:14:38,611 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478610"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232478610"}]},"ts":"1689232478610"} 2023-07-13 07:14:38,613 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:14:38,614 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:14:38,615 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232478615"}]},"ts":"1689232478615"} 2023-07-13 07:14:38,616 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-13 07:14:38,620 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:14:38,622 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:14:38,622 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:14:38,622 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:14:38,622 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:14:38,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, ASSIGN}] 2023-07-13 07:14:38,626 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, ASSIGN 2023-07-13 07:14:38,626 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, ASSIGN 2023-07-13 07:14:38,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:14:38,627 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:14:38,627 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44055,1689232402206; forceNewPlan=false, retain=false 2023-07-13 07:14:38,777 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:14:38,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e8059ae7e77b5de84b7fb616b3d36992, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,781 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=084f5b0cf159b57f8597f573446d343e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478781"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232478781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232478781"}]},"ts":"1689232478781"} 2023-07-13 07:14:38,781 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478781"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232478781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232478781"}]},"ts":"1689232478781"} 2023-07-13 07:14:38,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e8059ae7e77b5de84b7fb616b3d36992, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:14:38,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 084f5b0cf159b57f8597f573446d343e, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:38,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:14:38,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8059ae7e77b5de84b7fb616b3d36992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.', STARTKEY => '', ENDKEY => '2'} 2023-07-13 07:14:38,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 084f5b0cf159b57f8597f573446d343e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.', STARTKEY => '2', ENDKEY => ''} 2023-07-13 07:14:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. service=AccessControlService 2023-07-13 07:14:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. service=AccessControlService 2023-07-13 07:14:38,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:38,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,945 INFO [StoreOpener-084f5b0cf159b57f8597f573446d343e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,946 INFO [StoreOpener-e8059ae7e77b5de84b7fb616b3d36992-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,948 DEBUG [StoreOpener-084f5b0cf159b57f8597f573446d343e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf 2023-07-13 07:14:38,948 DEBUG [StoreOpener-e8059ae7e77b5de84b7fb616b3d36992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf 2023-07-13 07:14:38,948 DEBUG [StoreOpener-084f5b0cf159b57f8597f573446d343e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf 2023-07-13 07:14:38,948 DEBUG [StoreOpener-e8059ae7e77b5de84b7fb616b3d36992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf 2023-07-13 07:14:38,948 INFO [StoreOpener-084f5b0cf159b57f8597f573446d343e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 084f5b0cf159b57f8597f573446d343e columnFamilyName cf 2023-07-13 07:14:38,948 INFO [StoreOpener-e8059ae7e77b5de84b7fb616b3d36992-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8059ae7e77b5de84b7fb616b3d36992 columnFamilyName cf 2023-07-13 07:14:38,949 INFO [StoreOpener-084f5b0cf159b57f8597f573446d343e-1] regionserver.HStore(310): Store=084f5b0cf159b57f8597f573446d343e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:38,949 INFO [StoreOpener-e8059ae7e77b5de84b7fb616b3d36992-1] regionserver.HStore(310): Store=e8059ae7e77b5de84b7fb616b3d36992/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:38,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:38,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:38,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:38,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e8059ae7e77b5de84b7fb616b3d36992; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59521791, jitterRate=-0.11305619776248932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:38,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e8059ae7e77b5de84b7fb616b3d36992: 2023-07-13 07:14:38,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 084f5b0cf159b57f8597f573446d343e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64163761, jitterRate=-0.043885454535484314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:38,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 084f5b0cf159b57f8597f573446d343e: 2023-07-13 07:14:38,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992., pid=69, masterSystemTime=1689232478935 2023-07-13 07:14:38,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e., pid=70, masterSystemTime=1689232478938 2023-07-13 07:14:38,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:38,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e8059ae7e77b5de84b7fb616b3d36992, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:38,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:38,958 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478958"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232478958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232478958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232478958"}]},"ts":"1689232478958"} 2023-07-13 07:14:38,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=084f5b0cf159b57f8597f573446d343e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:38,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232478959"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232478959"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232478959"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232478959"}]},"ts":"1689232478959"} 2023-07-13 07:14:38,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-13 07:14:38,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-13 07:14:38,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 084f5b0cf159b57f8597f573446d343e, server=jenkins-hbase20.apache.org,38771,1689232402287 in 174 msec 2023-07-13 07:14:38,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e8059ae7e77b5de84b7fb616b3d36992, server=jenkins-hbase20.apache.org,44055,1689232402206 in 176 msec 2023-07-13 07:14:38,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, ASSIGN in 345 msec 2023-07-13 07:14:38,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-13 07:14:38,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, ASSIGN in 345 msec 2023-07-13 07:14:38,969 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:14:38,970 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232478970"}]},"ts":"1689232478970"} 2023-07-13 07:14:38,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-13 07:14:38,976 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:14:38,977 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-13 07:14:38,979 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 07:14:38,989 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:38,989 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:38,989 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:38,989 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,991 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:38,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 477 msec 2023-07-13 07:14:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-13 07:14:39,131 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-13 07:14:39,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:39,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e], force=true 2023-07-13 07:14:39,172 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e], force=true 2023-07-13 07:14:39,172 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e], force=true 2023-07-13 07:14:39,172 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e], force=true 2023-07-13 07:14:39,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:14:39,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, UNASSIGN}] 2023-07-13 07:14:39,202 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, UNASSIGN 2023-07-13 07:14:39,202 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, UNASSIGN 2023-07-13 07:14:39,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=084f5b0cf159b57f8597f573446d343e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:39,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e8059ae7e77b5de84b7fb616b3d36992, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:39,204 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232479203"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232479203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232479203"}]},"ts":"1689232479203"} 2023-07-13 07:14:39,204 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232479203"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232479203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232479203"}]},"ts":"1689232479203"} 2023-07-13 07:14:39,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 084f5b0cf159b57f8597f573446d343e, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:39,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure e8059ae7e77b5de84b7fb616b3d36992, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:14:39,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:14:39,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:39,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 084f5b0cf159b57f8597f573446d343e, disabling compactions & flushes 2023-07-13 07:14:39,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:39,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:39,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. after waiting 0 ms 2023-07-13 07:14:39,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:39,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 084f5b0cf159b57f8597f573446d343e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 07:14:39,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:39,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e8059ae7e77b5de84b7fb616b3d36992, disabling compactions & flushes 2023-07-13 07:14:39,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:39,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:39,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. after waiting 0 ms 2023-07-13 07:14:39,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:39,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e8059ae7e77b5de84b7fb616b3d36992 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-13 07:14:39,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/.tmp/cf/4533da65f4124503904b231b471e55f8 2023-07-13 07:14:39,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/.tmp/cf/f12bf89cb7cc4c41972cc0d3e98ddc37 2023-07-13 07:14:39,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/.tmp/cf/f12bf89cb7cc4c41972cc0d3e98ddc37 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37 2023-07-13 07:14:39,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/.tmp/cf/4533da65f4124503904b231b471e55f8 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8 2023-07-13 07:14:39,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 07:14:39,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37, entries=1, sequenceid=5, filesize=4.7 K 2023-07-13 07:14:39,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 084f5b0cf159b57f8597f573446d343e in 25ms, sequenceid=5, compaction requested=false 2023-07-13 07:14:39,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 07:14:39,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e8059ae7e77b5de84b7fb616b3d36992 in 22ms, sequenceid=5, compaction requested=false 2023-07-13 07:14:39,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 07:14:39,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 07:14:39,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-13 07:14:39,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:39,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992. 2023-07-13 07:14:39,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e8059ae7e77b5de84b7fb616b3d36992: 2023-07-13 07:14:39,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:39,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e. 2023-07-13 07:14:39,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 084f5b0cf159b57f8597f573446d343e: 2023-07-13 07:14:39,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:39,398 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e8059ae7e77b5de84b7fb616b3d36992, regionState=CLOSED 2023-07-13 07:14:39,398 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232479398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232479398"}]},"ts":"1689232479398"} 2023-07-13 07:14:39,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:39,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=084f5b0cf159b57f8597f573446d343e, regionState=CLOSED 2023-07-13 07:14:39,399 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689232479399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232479399"}]},"ts":"1689232479399"} 2023-07-13 07:14:39,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-13 07:14:39,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure e8059ae7e77b5de84b7fb616b3d36992, server=jenkins-hbase20.apache.org,44055,1689232402206 in 193 msec 2023-07-13 07:14:39,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-13 07:14:39,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 084f5b0cf159b57f8597f573446d343e, server=jenkins-hbase20.apache.org,38771,1689232402287 in 194 msec 2023-07-13 07:14:39,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e8059ae7e77b5de84b7fb616b3d36992, UNASSIGN in 206 msec 2023-07-13 07:14:39,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-13 07:14:39,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=084f5b0cf159b57f8597f573446d343e, UNASSIGN in 203 msec 2023-07-13 07:14:39,463 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-13 07:14:39,467 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478513.e8059ae7e77b5de84b7fb616b3d36992.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:39,467 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689232478513.084f5b0cf159b57f8597f573446d343e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:39,467 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:39,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:14:39,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, ASSIGN}] 2023-07-13 07:14:39,516 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, ASSIGN 2023-07-13 07:14:39,517 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,44055,1689232402206; forceNewPlan=false, retain=false 2023-07-13 07:14:39,667 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-13 07:14:39,669 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4f14bef85e2170d6be1841acb420d735, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:39,669 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232479669"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232479669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232479669"}]},"ts":"1689232479669"} 2023-07-13 07:14:39,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4f14bef85e2170d6be1841acb420d735, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:14:39,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:14:39,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:39,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f14bef85e2170d6be1841acb420d735, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.', STARTKEY => '', ENDKEY => ''} 2023-07-13 07:14:39,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. service=AccessControlService 2023-07-13 07:14:39,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:39,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:39,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/.regioninfo 2023-07-13 07:14:39,838 INFO [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,839 DEBUG [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf 2023-07-13 07:14:39,839 DEBUG [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf 2023-07-13 07:14:39,840 INFO [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f14bef85e2170d6be1841acb420d735 columnFamilyName cf 2023-07-13 07:14:39,864 DEBUG [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/4533da65f4124503904b231b471e55f8.084f5b0cf159b57f8597f573446d343e->hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8-top 2023-07-13 07:14:39,871 DEBUG [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/f12bf89cb7cc4c41972cc0d3e98ddc37.e8059ae7e77b5de84b7fb616b3d36992->hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37-top 2023-07-13 07:14:39,872 INFO [StoreOpener-4f14bef85e2170d6be1841acb420d735-1] regionserver.HStore(310): Store=4f14bef85e2170d6be1841acb420d735/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:39,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:39,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4f14bef85e2170d6be1841acb420d735; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64323320, jitterRate=-0.041507840156555176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:39,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4f14bef85e2170d6be1841acb420d735: 2023-07-13 07:14:39,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735., pid=77, masterSystemTime=1689232479822 2023-07-13 07:14:39,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.,because compaction is disabled. 2023-07-13 07:14:39,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:39,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:39,882 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4f14bef85e2170d6be1841acb420d735, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:39,882 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232479882"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232479882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232479882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232479882"}]},"ts":"1689232479882"} 2023-07-13 07:14:39,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-13 07:14:39,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4f14bef85e2170d6be1841acb420d735, server=jenkins-hbase20.apache.org,44055,1689232402206 in 212 msec 2023-07-13 07:14:39,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-13 07:14:39,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, ASSIGN in 370 msec 2023-07-13 07:14:39,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e8059ae7e77b5de84b7fb616b3d36992, 084f5b0cf159b57f8597f573446d343e], force=true in 722 msec 2023-07-13 07:14:40,215 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0004_000001 (auth:SIMPLE) 2023-07-13 07:14:40,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-13 07:14:40,281 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-13 07:14:40,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:14:40,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232480281 (current time:1689232480281). 2023-07-13 07:14:40,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:40,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x643bd64d to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca6c6c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:40,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:40,294 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x643bd64d to 127.0.0.1:61300 2023-07-13 07:14:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x1e6375ce to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:40,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@245051f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:40,308 DEBUG [hconnection-0x4e2a1b66-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:40,313 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:40,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:40,323 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:40,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e6375ce to 127.0.0.1:61300 2023-07-13 07:14:40,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:40,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-13 07:14:40,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:40,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:14:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:14:40,331 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:14:40,332 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689233080332 2023-07-13 07:14:40,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-13 07:14:40,337 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:40,337 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:40,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:14:40,345 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-13 07:14:40,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-07-13 07:14:40,349 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:14:40,350 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689233080350 2023-07-13 07:14:40,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,381 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-13 07:14:40,381 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:40,382 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-13 07:14:40,382 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-13 07:14:40,383 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,383 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,384 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,384 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,384 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,384 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,384 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:14:40,387 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:14:40,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-13 07:14:40,387 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:40,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,387 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:14:40,388 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:40,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,388 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-13 07:14:40,390 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:40,389 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:14:40,391 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-13 07:14:40,391 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-13 07:14:40,391 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-13 07:14:40,397 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,397 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,397 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,402 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:40,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-13 07:14:40,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ba7b00[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:40,404 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-13 07:14:40,404 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:14:40,405 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:14:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:14:40,405 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,405 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-13 07:14:40,405 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:14:40,406 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:40,407 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:14:40,421 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:40,429 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:40,429 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:40,429 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. started... 2023-07-13 07:14:40,431 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f14bef85e2170d6be1841acb420d735: 2023-07-13 07:14:40,431 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,431 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:40,431 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/4533da65f4124503904b231b471e55f8.084f5b0cf159b57f8597f573446d343e->hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8-top, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/f12bf89cb7cc4c41972cc0d3e98ddc37.e8059ae7e77b5de84b7fb616b3d36992->hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37-top] hfiles 2023-07-13 07:14:40,431 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/4533da65f4124503904b231b471e55f8.084f5b0cf159b57f8597f573446d343e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,432 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/f12bf89cb7cc4c41972cc0d3e98ddc37.e8059ae7e77b5de84b7fb616b3d36992 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,437 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:40,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 07:14:40,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:40,439 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:40,493 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. completed. 2023-07-13 07:14:40,493 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:40,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:40,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:40,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-13 07:14:40,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:40,498 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-13 07:14:40,498 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,498 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:40,498 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-13 07:14:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:14:40,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-13 07:14:40,503 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-13 07:14:40,504 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:40,504 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:40,504 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,504 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:40,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,527 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,528 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,529 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:40,531 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,533 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,533 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,533 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:40,536 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:40,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:40,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,536 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,536 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:40,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,537 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,538 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:40,538 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:40,538 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,538 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:40,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-13 07:14:40,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,608 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689232480332Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232480537 (+205 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232480537Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232480550 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689232480570 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689232480608 (+38 ms) 2023-07-13 07:14:40,612 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-13 07:14:40,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 275 msec 2023-07-13 07:14:40,639 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:40,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-13 07:14:40,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:40,641 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641 2023-07-13 07:14:40,641 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:42973, tgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641, rawTgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:40,659 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:40,659 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2097444238_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,659 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-13 07:14:40,668 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:40,702 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,703 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,704 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,704 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,704 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,705 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,705 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,776 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-4186983652209884692.jar 2023-07-13 07:14:40,776 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,777 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,778 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,778 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,779 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,779 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:40,779 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:14:40,780 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:14:40,780 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:14:40,781 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:14:40,781 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:14:40,782 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:14:40,782 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:14:40,783 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:14:40,783 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:14:40,784 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:14:40,784 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:40,784 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:40,785 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:40,785 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:40,785 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:40,785 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:40,786 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:41,495 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:14:41,528 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:14:41,531 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-13 07:14:41,533 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-13 07:14:42,107 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:42,107 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:42,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0005_000001 (auth:SIMPLE) 2023-07-13 07:14:47,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0005_000001 (auth:SIMPLE) 2023-07-13 07:14:49,796 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0005_000001 (auth:SIMPLE) 2023-07-13 07:14:52,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0005_000001 (auth:SIMPLE) 2023-07-13 07:14:54,259 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:14:54,260 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:14:54,269 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,269 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:14:54,270 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:14:54,270 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,271 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 07:14:54,271 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 07:14:54,271 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,272 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-13 07:14:54,272 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232480641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-13 07:14:54,280 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:14:54,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232494288"}]},"ts":"1689232494288"} 2023-07-13 07:14:54,290 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-13 07:14:54,291 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-13 07:14:54,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, UNASSIGN}] 2023-07-13 07:14:54,294 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, UNASSIGN 2023-07-13 07:14:54,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4f14bef85e2170d6be1841acb420d735, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:54,296 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232494295"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232494295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232494295"}]},"ts":"1689232494295"} 2023-07-13 07:14:54,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4f14bef85e2170d6be1841acb420d735, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:14:54,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:14:54,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:54,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4f14bef85e2170d6be1841acb420d735, disabling compactions & flushes 2023-07-13 07:14:54,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:54,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:54,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. after waiting 0 ms 2023-07-13 07:14:54,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:54,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-13 07:14:54,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:54,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735. 2023-07-13 07:14:54,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4f14bef85e2170d6be1841acb420d735: 2023-07-13 07:14:54,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:54,468 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4f14bef85e2170d6be1841acb420d735, regionState=CLOSED 2023-07-13 07:14:54,468 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689232494468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232494468"}]},"ts":"1689232494468"} 2023-07-13 07:14:54,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-13 07:14:54,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4f14bef85e2170d6be1841acb420d735, server=jenkins-hbase20.apache.org,44055,1689232402206 in 170 msec 2023-07-13 07:14:54,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-13 07:14:54,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f14bef85e2170d6be1841acb420d735, UNASSIGN in 178 msec 2023-07-13 07:14:54,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232494472"}]},"ts":"1689232494472"} 2023-07-13 07:14:54,474 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-13 07:14:54,475 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-13 07:14:54,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 196 msec 2023-07-13 07:14:54,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-13 07:14:54,591 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-13 07:14:54,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,595 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,597 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,599 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,599 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,599 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:14:54,599 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:14:54,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:14:54,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,600 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,600 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:54,600 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:54,600 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:54,601 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:54,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:54,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:54,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:54,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:54,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 07:14:54,604 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/recovered.edits] 2023-07-13 07:14:54,604 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/recovered.edits] 2023-07-13 07:14:54,605 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/recovered.edits] 2023-07-13 07:14:54,608 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/4533da65f4124503904b231b471e55f8.084f5b0cf159b57f8597f573446d343e to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/4533da65f4124503904b231b471e55f8.084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:54,608 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/cf/4533da65f4124503904b231b471e55f8 2023-07-13 07:14:54,608 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/cf/f12bf89cb7cc4c41972cc0d3e98ddc37 2023-07-13 07:14:54,609 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/f12bf89cb7cc4c41972cc0d3e98ddc37.e8059ae7e77b5de84b7fb616b3d36992 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/cf/f12bf89cb7cc4c41972cc0d3e98ddc37.e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:54,611 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/recovered.edits/8.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e/recovered.edits/8.seqid 2023-07-13 07:14:54,611 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/recovered.edits/8.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992/recovered.edits/8.seqid 2023-07-13 07:14:54,616 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/recovered.edits/12.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735/recovered.edits/12.seqid 2023-07-13 07:14:54,616 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e8059ae7e77b5de84b7fb616b3d36992 2023-07-13 07:14:54,616 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/084f5b0cf159b57f8597f573446d343e 2023-07-13 07:14:54,617 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f14bef85e2170d6be1841acb420d735 2023-07-13 07:14:54,617 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-13 07:14:54,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,622 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-13 07:14:54,624 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-13 07:14:54,625 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,625 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-13 07:14:54,626 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232494625"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:54,627 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-13 07:14:54,627 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4f14bef85e2170d6be1841acb420d735, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689232478514.4f14bef85e2170d6be1841acb420d735.', STARTKEY => '', ENDKEY => ''}] 2023-07-13 07:14:54,627 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-13 07:14:54,627 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232494627"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:54,629 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-13 07:14:54,630 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:54,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 38 msec 2023-07-13 07:14:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-13 07:14:54,704 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-13 07:14:54,704 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:54,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:54,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:54,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:14:54,709 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232494708"}]},"ts":"1689232494708"} 2023-07-13 07:14:54,710 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-13 07:14:54,711 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-13 07:14:54,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, UNASSIGN}] 2023-07-13 07:14:54,714 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, UNASSIGN 2023-07-13 07:14:54,714 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, UNASSIGN 2023-07-13 07:14:54,715 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1f7569b6bd6e3a2fd227cdf7ed049fa8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:54,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=517e3b152e309e14e11d0b6891728406, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:54,715 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232494715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232494715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232494715"}]},"ts":"1689232494715"} 2023-07-13 07:14:54,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232494715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232494715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232494715"}]},"ts":"1689232494715"} 2023-07-13 07:14:54,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 517e3b152e309e14e11d0b6891728406, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:14:54,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 1f7569b6bd6e3a2fd227cdf7ed049fa8, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:54,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:14:54,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 517e3b152e309e14e11d0b6891728406, disabling compactions & flushes 2023-07-13 07:14:54,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. after waiting 0 ms 2023-07-13 07:14:54,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:54,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:54,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1f7569b6bd6e3a2fd227cdf7ed049fa8, disabling compactions & flushes 2023-07-13 07:14:54,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:54,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:54,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. after waiting 0 ms 2023-07-13 07:14:54,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:54,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:54,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:14:54,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:54,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406. 2023-07-13 07:14:54,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 517e3b152e309e14e11d0b6891728406: 2023-07-13 07:14:54,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:14:54,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8. 2023-07-13 07:14:54,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1f7569b6bd6e3a2fd227cdf7ed049fa8: 2023-07-13 07:14:54,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:54,912 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=517e3b152e309e14e11d0b6891728406, regionState=CLOSED 2023-07-13 07:14:54,912 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232494912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232494912"}]},"ts":"1689232494912"} 2023-07-13 07:14:54,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:54,913 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1f7569b6bd6e3a2fd227cdf7ed049fa8, regionState=CLOSED 2023-07-13 07:14:54,913 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689232494913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232494913"}]},"ts":"1689232494913"} 2023-07-13 07:14:54,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-13 07:14:54,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 517e3b152e309e14e11d0b6891728406, server=jenkins-hbase20.apache.org,38771,1689232402287 in 197 msec 2023-07-13 07:14:54,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-13 07:14:54,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=517e3b152e309e14e11d0b6891728406, UNASSIGN in 209 msec 2023-07-13 07:14:54,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 1f7569b6bd6e3a2fd227cdf7ed049fa8, server=jenkins-hbase20.apache.org,46789,1689232402346 in 197 msec 2023-07-13 07:14:54,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-13 07:14:54,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f7569b6bd6e3a2fd227cdf7ed049fa8, UNASSIGN in 211 msec 2023-07-13 07:14:54,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232494926"}]},"ts":"1689232494926"} 2023-07-13 07:14:54,927 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-13 07:14:54,928 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-13 07:14:54,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 224 msec 2023-07-13 07:14:55,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-13 07:14:55,011 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-13 07:14:55,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,017 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,019 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,021 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:55,021 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:55,021 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,021 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,021 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,021 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:14:55,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:14:55,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:14:55,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,023 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 07:14:55,025 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/recovered.edits] 2023-07-13 07:14:55,025 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/recovered.edits] 2023-07-13 07:14:55,029 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/cf/52be9d8091d44f8c9585e7a450ebd57a 2023-07-13 07:14:55,029 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/cf/07db5b03179149c7a8184306e24b4ac6 2023-07-13 07:14:55,031 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8/recovered.edits/9.seqid 2023-07-13 07:14:55,032 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406/recovered.edits/9.seqid 2023-07-13 07:14:55,032 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f7569b6bd6e3a2fd227cdf7ed049fa8 2023-07-13 07:14:55,032 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/517e3b152e309e14e11d0b6891728406 2023-07-13 07:14:55,032 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-13 07:14:55,033 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-13 07:14:55,033 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-13 07:14:55,041 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071346dea5f28d3a4f27adf1dd29974c58eb 2023-07-13 07:14:55,047 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230713e126899821d64a4bbbda0e19665d93ed 2023-07-13 07:14:55,053 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-13 07:14:55,057 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,060 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-13 07:14:55,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-13 07:14:55,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-13 07:14:55,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232495079"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:55,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232495079"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:55,081 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:14:55,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 517e3b152e309e14e11d0b6891728406, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689232476376.517e3b152e309e14e11d0b6891728406.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1f7569b6bd6e3a2fd227cdf7ed049fa8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689232476376.1f7569b6bd6e3a2fd227cdf7ed049fa8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:14:55,082 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-13 07:14:55,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232495082"}]},"ts":"9223372036854775807"} 2023-07-13 07:14:55,084 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-13 07:14:55,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 72 msec 2023-07-13 07:14:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-13 07:14:55,126 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-13 07:14:55,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 07:14:55,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-13 07:14:55,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-13 07:14:55,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-13 07:14:55,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-13 07:14:55,168 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 744) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3989 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:38737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:45116 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-146595857_1 at /127.0.0.1:58372 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:58394 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:47002 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 301) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=2495 (was 3128) 2023-07-13 07:14:55,168 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-13 07:14:55,185 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=173, AvailableMemoryMB=2494 2023-07-13 07:14:55,185 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-13 07:14:55,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:14:55,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:14:55,190 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:14:55,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-13 07:14:55,191 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:14:55,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:14:55,193 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,193 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,194 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 empty. 2023-07-13 07:14:55,194 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 empty. 2023-07-13 07:14:55,194 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,194 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,195 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 07:14:55,213 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-13 07:14:55,214 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e45f0314500ee387226e3ca4abd9d03, NAME => 'testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:55,215 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c32b8b15d57c7aa49cd4a5086961bf25, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0e45f0314500ee387226e3ca4abd9d03, disabling compactions & flushes 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c32b8b15d57c7aa49cd4a5086961bf25, disabling compactions & flushes 2023-07-13 07:14:55,251 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,251 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. after waiting 0 ms 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. after waiting 0 ms 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,251 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,251 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,251 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0e45f0314500ee387226e3ca4abd9d03: 2023-07-13 07:14:55,252 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c32b8b15d57c7aa49cd4a5086961bf25: 2023-07-13 07:14:55,254 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:14:55,254 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232495254"}]},"ts":"1689232495254"} 2023-07-13 07:14:55,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232495254"}]},"ts":"1689232495254"} 2023-07-13 07:14:55,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:14:55,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:14:55,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232495257"}]},"ts":"1689232495257"} 2023-07-13 07:14:55,269 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-13 07:14:55,272 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:14:55,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:14:55,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:14:55,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:14:55,274 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:14:55,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, ASSIGN}] 2023-07-13 07:14:55,277 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, ASSIGN 2023-07-13 07:14:55,277 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, ASSIGN 2023-07-13 07:14:55,278 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44055,1689232402206; forceNewPlan=false, retain=false 2023-07-13 07:14:55,278 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46789,1689232402346; forceNewPlan=false, retain=false 2023-07-13 07:14:55,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:14:55,429 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:14:55,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c32b8b15d57c7aa49cd4a5086961bf25, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:55,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0e45f0314500ee387226e3ca4abd9d03, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:55,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495432"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232495432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232495432"}]},"ts":"1689232495432"} 2023-07-13 07:14:55,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495432"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232495432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232495432"}]},"ts":"1689232495432"} 2023-07-13 07:14:55,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure c32b8b15d57c7aa49cd4a5086961bf25, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:14:55,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0e45f0314500ee387226e3ca4abd9d03, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:14:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:14:55,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e45f0314500ee387226e3ca4abd9d03, NAME => 'testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:14:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. service=AccessControlService 2023-07-13 07:14:55,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c32b8b15d57c7aa49cd4a5086961bf25, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:14:55,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. service=AccessControlService 2023-07-13 07:14:55,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:14:55,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:14:55,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,601 INFO [StoreOpener-0e45f0314500ee387226e3ca4abd9d03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,603 INFO [StoreOpener-c32b8b15d57c7aa49cd4a5086961bf25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,604 DEBUG [StoreOpener-0e45f0314500ee387226e3ca4abd9d03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf 2023-07-13 07:14:55,604 DEBUG [StoreOpener-0e45f0314500ee387226e3ca4abd9d03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf 2023-07-13 07:14:55,604 INFO [StoreOpener-0e45f0314500ee387226e3ca4abd9d03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e45f0314500ee387226e3ca4abd9d03 columnFamilyName cf 2023-07-13 07:14:55,606 INFO [StoreOpener-0e45f0314500ee387226e3ca4abd9d03-1] regionserver.HStore(310): Store=0e45f0314500ee387226e3ca4abd9d03/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:55,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,611 DEBUG [StoreOpener-c32b8b15d57c7aa49cd4a5086961bf25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf 2023-07-13 07:14:55,612 DEBUG [StoreOpener-c32b8b15d57c7aa49cd4a5086961bf25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf 2023-07-13 07:14:55,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:14:55,617 INFO [StoreOpener-c32b8b15d57c7aa49cd4a5086961bf25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c32b8b15d57c7aa49cd4a5086961bf25 columnFamilyName cf 2023-07-13 07:14:55,623 INFO [StoreOpener-c32b8b15d57c7aa49cd4a5086961bf25-1] regionserver.HStore(310): Store=c32b8b15d57c7aa49cd4a5086961bf25/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:14:55,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:55,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0e45f0314500ee387226e3ca4abd9d03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66159447, jitterRate=-0.01414741575717926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:55,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0e45f0314500ee387226e3ca4abd9d03: 2023-07-13 07:14:55,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03., pid=94, masterSystemTime=1689232495591 2023-07-13 07:14:55,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,635 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0e45f0314500ee387226e3ca4abd9d03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:55,635 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495635"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232495635"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232495635"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232495635"}]},"ts":"1689232495635"} 2023-07-13 07:14:55,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:14:55,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-13 07:14:55,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0e45f0314500ee387226e3ca4abd9d03, server=jenkins-hbase20.apache.org,44055,1689232402206 in 201 msec 2023-07-13 07:14:55,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, ASSIGN in 365 msec 2023-07-13 07:14:55,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:14:55,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c32b8b15d57c7aa49cd4a5086961bf25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72128450, jitterRate=0.07479766011238098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:14:55,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c32b8b15d57c7aa49cd4a5086961bf25: 2023-07-13 07:14:55,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25., pid=93, masterSystemTime=1689232495590 2023-07-13 07:14:55,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:55,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c32b8b15d57c7aa49cd4a5086961bf25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:55,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232495651"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232495651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232495651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232495651"}]},"ts":"1689232495651"} 2023-07-13 07:14:55,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-13 07:14:55,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure c32b8b15d57c7aa49cd4a5086961bf25, server=jenkins-hbase20.apache.org,46789,1689232402346 in 219 msec 2023-07-13 07:14:55,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-13 07:14:55,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, ASSIGN in 381 msec 2023-07-13 07:14:55,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:14:55,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232495657"}]},"ts":"1689232495657"} 2023-07-13 07:14:55,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-13 07:14:55,661 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:14:55,661 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-13 07:14:55,663 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:14:55,664 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,664 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,664 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:55,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:55,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:55,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 479 msec 2023-07-13 07:14:55,670 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:14:55,671 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-13 07:14:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-13 07:14:55,797 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-13 07:14:55,801 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:55,801 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:55,803 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:55,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:55,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232495825 (current time:1689232495825). 2023-07-13 07:14:55,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:55,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x5460018a to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:55,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@615aaa33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:55,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:55,873 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:55,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5460018a to 127.0.0.1:61300 2023-07-13 07:14:55,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:55,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x7d6d3e30 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:55,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29551c46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:55,988 DEBUG [hconnection-0x1d6a306d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:55,992 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:56,002 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:56,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d6d3e30 to 127.0.0.1:61300 2023-07-13 07:14:56,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:14:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:56,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:56,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,011 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,014 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233096014 2023-07-13 07:14:56,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:56,016 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:56,017 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:56,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:56,018 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-13 07:14:56,023 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:56,025 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233096025 2023-07-13 07:14:56,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,051 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-13 07:14:56,051 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,052 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 07:14:56,052 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:14:56,107 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,107 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,109 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,109 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,109 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,109 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:14:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,111 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,112 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,112 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,112 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,114 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:14:56,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,114 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,115 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,116 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,116 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:56,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-13 07:14:56,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,117 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:56,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,117 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,117 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,119 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,119 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,119 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:56,119 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:56,119 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,121 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,121 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,121 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,125 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:56,126 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,126 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,131 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,131 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,131 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,131 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,131 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,132 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,131 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fc2e00c[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:14:56,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fc2e00c[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:56,135 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:14:56,135 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,135 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,135 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,136 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,136 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,136 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,136 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:56,136 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:56,137 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,137 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:56,137 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:56,137 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:56,137 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:56,138 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:56,145 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:56,145 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:56,144 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:56,145 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:56,145 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. started... 2023-07-13 07:14:56,145 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:56,147 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. started... 2023-07-13 07:14:56,147 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e45f0314500ee387226e3ca4abd9d03: 2023-07-13 07:14:56,147 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,147 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:56,147 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:56,148 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c32b8b15d57c7aa49cd4a5086961bf25: 2023-07-13 07:14:56,148 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,148 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:56,148 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:14:56,173 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. completed. 2023-07-13 07:14:56,174 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:56,174 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:56,174 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:56,174 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,174 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:56,174 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:56,176 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,176 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:56,176 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:56,176 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,179 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. completed. 2023-07-13 07:14:56,179 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,179 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:56,179 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:56,179 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,179 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:56,179 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,180 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,180 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,180 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:56,180 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:14:56,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:14:56,186 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 07:14:56,186 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:56,186 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:56,186 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,186 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:56,187 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,187 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,191 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,192 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,192 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,195 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,195 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,195 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,197 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,198 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,200 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,200 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:56,198 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:56,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:56,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,200 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,201 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,201 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,201 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,201 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,201 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:14:56,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:56,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,326 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:56,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:56,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:56,340 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:14:56,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 07:14:56,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,414 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689232496014Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689232496258 (+244 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689232496258Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689232496258Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689232496278 (+20 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689232496340 (+62 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689232496413 (+73 ms) 2023-07-13 07:14:56,420 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:56,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 404 msec 2023-07-13 07:14:56,640 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:56,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:56,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:56,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44055] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:56,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46789] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:14:56,658 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:56,658 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:56,658 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:14:56,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:56,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232496677 (current time:1689232496677). 2023-07-13 07:14:56,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:14:56,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x4c64a91f to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:56,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4111a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:56,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:56,733 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:56,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c64a91f to 127.0.0.1:61300 2023-07-13 07:14:56,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:56,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x555144ba to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:14:56,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c14335e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:14:56,840 DEBUG [hconnection-0x3450d95b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:56,841 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:14:56,852 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:14:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x555144ba to 127.0.0.1:61300 2023-07-13 07:14:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:14:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-13 07:14:56,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:14:56,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:56,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,859 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,861 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689233096861 2023-07-13 07:14:56,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-13 07:14:56,863 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:14:56,863 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:14:56,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:56,867 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-13 07:14:56,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-13 07:14:56,872 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:56,873 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689233096873 2023-07-13 07:14:56,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,923 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-13 07:14:56,923 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,932 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-13 07:14:56,932 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-13 07:14:56,932 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,933 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,934 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,934 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,934 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:56,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,935 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,935 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-13 07:14:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-13 07:14:56,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,943 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,943 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,948 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,951 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,951 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-13 07:14:56,951 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,951 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:14:56,951 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,961 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,961 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,952 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-13 07:14:56,963 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,963 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,963 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-13 07:14:56,964 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-13 07:14:56,964 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,965 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:56,965 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:14:56,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,967 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,968 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:14:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ccd1207[Count = 1] remaining members to acquire global barrier 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:56,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-13 07:14:56,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ccd1207[Count = 0] remaining members to acquire global barrier 2023-07-13 07:14:56,971 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-13 07:14:56,971 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,980 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,981 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,981 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:56,981 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:14:56,981 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,981 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:56,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,981 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:14:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:56,981 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-13 07:14:56,985 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:56,985 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:56,985 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:57,002 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:57,004 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:14:57,008 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:57,008 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:14:57,008 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. started... 2023-07-13 07:14:57,008 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. started... 2023-07-13 07:14:57,008 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e45f0314500ee387226e3ca4abd9d03 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-13 07:14:57,008 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c32b8b15d57c7aa49cd4a5086961bf25 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-13 07:14:57,117 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c 2023-07-13 07:14:57,117 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94 2023-07-13 07:14:57,143 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/.tmp/cf/3919f9455cc74ba780f257b1101835be 2023-07-13 07:14:57,152 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/.tmp/cf/01f27c6f1d734c2ba9f97549986c46e4 2023-07-13 07:14:57,153 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/.tmp/cf/3919f9455cc74ba780f257b1101835be as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be 2023-07-13 07:14:57,158 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/.tmp/cf/01f27c6f1d734c2ba9f97549986c46e4 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4 2023-07-13 07:14:57,158 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be, entries=4, sequenceid=6, filesize=5.6 K 2023-07-13 07:14:57,160 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 0e45f0314500ee387226e3ca4abd9d03 in 152ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:57,160 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-13 07:14:57,161 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e45f0314500ee387226e3ca4abd9d03: 2023-07-13 07:14:57,161 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,161 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:57,161 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be] hfiles 2023-07-13 07:14:57,161 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,166 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:57,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:57,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:14:57,167 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-13 07:14:57,168 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4, entries=46, sequenceid=6, filesize=12.9 K 2023-07-13 07:14:57,169 INFO [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c32b8b15d57c7aa49cd4a5086961bf25 in 161ms, sequenceid=6, compaction requested=false 2023-07-13 07:14:57,180 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c32b8b15d57c7aa49cd4a5086961bf25: 2023-07-13 07:14:57,181 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,182 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:14:57,182 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4] hfiles 2023-07-13 07:14:57,183 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,193 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. completed. 2023-07-13 07:14:57,193 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:14:57,193 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:57,193 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:57,193 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:14:57,195 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,195 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:57,195 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:57,195 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:14:57,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-13 07:14:57,204 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. completed. 2023-07-13 07:14:57,205 DEBUG [rs(jenkins-hbase20.apache.org,46789,1689232402346)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:14:57,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:14:57,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:14:57,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-13 07:14:57,205 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:14:57,219 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-13 07:14:57,219 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,219 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:57,219 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-13 07:14:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:57,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:57,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,46789,1689232402346': 2023-07-13 07:14:57,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-13 07:14:57,226 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-13 07:14:57,226 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:14:57,226 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:14:57,226 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,226 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:14:57,227 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,228 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:14:57,229 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,230 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:14:57,230 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:14:57,232 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,232 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,233 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,235 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:14:57,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:57,235 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:57,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:14:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:14:57,237 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,238 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-13 07:14:57,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,237 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:14:57,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:14:57,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:14:57,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:14:57,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94] mob files 2023-07-13 07:14:57,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c 2023-07-13 07:14:57,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94 2023-07-13 07:14:57,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-13 07:14:57,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,442 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689232496861Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689232497263 (+402 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689232497263Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689232497263Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689232497299 (+36 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689232497363 (+64 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689232497441 (+78 ms) 2023-07-13 07:14:57,448 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-13 07:14:57,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 585 msec 2023-07-13 07:14:57,467 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:14:57,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-13 07:14:57,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:14:57,468 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468 2023-07-13 07:14:57,468 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:42973, tgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468, rawTgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:57,491 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:14:57,491 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_706388742_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,491 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-13 07:14:57,535 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:14:57,685 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,686 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,686 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,687 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,687 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,687 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,688 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,760 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-7554577490962601099.jar 2023-07-13 07:14:57,761 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,761 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,762 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,762 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,763 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,763 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:14:57,763 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:14:57,764 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:14:57,764 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:14:57,764 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:14:57,765 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:14:57,765 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:14:57,765 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:14:57,766 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:14:57,766 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:14:57,767 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:14:57,767 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:57,767 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:57,768 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:57,768 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:57,768 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:14:57,769 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:57,769 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:14:58,329 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:14:58,332 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-13 07:14:58,941 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:58,941 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:14:58,945 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0005_000001 (auth:SIMPLE) 2023-07-13 07:14:59,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0006_000001 (auth:SIMPLE) 2023-07-13 07:15:00,054 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:15:04,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0006_000001 (auth:SIMPLE) 2023-07-13 07:15:07,133 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:15:07,134 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:15:07,144 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:15:07,144 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:15:07,145 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 07:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 07:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:15:07,146 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-13 07:15:07,146 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232497468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-13 07:15:07,152 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,157 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232507157"}]},"ts":"1689232507157"} 2023-07-13 07:15:07,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:15:07,158 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-13 07:15:07,159 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-13 07:15:07,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, UNASSIGN}] 2023-07-13 07:15:07,162 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, UNASSIGN 2023-07-13 07:15:07,162 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, UNASSIGN 2023-07-13 07:15:07,163 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0e45f0314500ee387226e3ca4abd9d03, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:07,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c32b8b15d57c7aa49cd4a5086961bf25, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:07,163 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232507163"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232507163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232507163"}]},"ts":"1689232507163"} 2023-07-13 07:15:07,163 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232507163"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232507163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232507163"}]},"ts":"1689232507163"} 2023-07-13 07:15:07,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0e45f0314500ee387226e3ca4abd9d03, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:15:07,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c32b8b15d57c7aa49cd4a5086961bf25, server=jenkins-hbase20.apache.org,46789,1689232402346}] 2023-07-13 07:15:07,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:15:07,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:15:07,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c32b8b15d57c7aa49cd4a5086961bf25, disabling compactions & flushes 2023-07-13 07:15:07,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. after waiting 0 ms 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:15:07,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0e45f0314500ee387226e3ca4abd9d03, disabling compactions & flushes 2023-07-13 07:15:07,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. after waiting 0 ms 2023-07-13 07:15:07,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:15:07,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:15:07,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:07,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03. 2023-07-13 07:15:07,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0e45f0314500ee387226e3ca4abd9d03: 2023-07-13 07:15:07,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:15:07,361 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0e45f0314500ee387226e3ca4abd9d03, regionState=CLOSED 2023-07-13 07:15:07,362 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232507361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232507361"}]},"ts":"1689232507361"} 2023-07-13 07:15:07,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:15:07,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:07,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-13 07:15:07,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0e45f0314500ee387226e3ca4abd9d03, server=jenkins-hbase20.apache.org,44055,1689232402206 in 198 msec 2023-07-13 07:15:07,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0e45f0314500ee387226e3ca4abd9d03, UNASSIGN in 210 msec 2023-07-13 07:15:07,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25. 2023-07-13 07:15:07,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c32b8b15d57c7aa49cd4a5086961bf25: 2023-07-13 07:15:07,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:15:07,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c32b8b15d57c7aa49cd4a5086961bf25, regionState=CLOSED 2023-07-13 07:15:07,376 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689232507376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232507376"}]},"ts":"1689232507376"} 2023-07-13 07:15:07,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-13 07:15:07,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c32b8b15d57c7aa49cd4a5086961bf25, server=jenkins-hbase20.apache.org,46789,1689232402346 in 212 msec 2023-07-13 07:15:07,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-13 07:15:07,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c32b8b15d57c7aa49cd4a5086961bf25, UNASSIGN in 223 msec 2023-07-13 07:15:07,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232507387"}]},"ts":"1689232507387"} 2023-07-13 07:15:07,390 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-13 07:15:07,391 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-13 07:15:07,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 239 msec 2023-07-13 07:15:07,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-13 07:15:07,460 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-13 07:15:07,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,466 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,467 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,467 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,467 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,467 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:15:07,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:15:07,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:15:07,468 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:07,468 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:15:07,468 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:15:07,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:07,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 07:15:07,470 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/recovered.edits] 2023-07-13 07:15:07,470 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/recovered.edits] 2023-07-13 07:15:07,483 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/cf/01f27c6f1d734c2ba9f97549986c46e4 2023-07-13 07:15:07,483 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/cf/3919f9455cc74ba780f257b1101835be 2023-07-13 07:15:07,487 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25/recovered.edits/9.seqid 2023-07-13 07:15:07,487 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/c32b8b15d57c7aa49cd4a5086961bf25 2023-07-13 07:15:07,487 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03/recovered.edits/9.seqid 2023-07-13 07:15:07,489 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testEmptyExportFileSystemState/0e45f0314500ee387226e3ca4abd9d03 2023-07-13 07:15:07,489 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-13 07:15:07,489 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-13 07:15:07,490 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-13 07:15:07,495 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071395c57c89c21741cb9ee88ced4eab670c 2023-07-13 07:15:07,496 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307139480d648b04e4f709d7a71789c31dc94 2023-07-13 07:15:07,497 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-13 07:15:07,498 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,500 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-13 07:15:07,502 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-13 07:15:07,503 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,504 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-13 07:15:07,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232507504"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:07,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232507504"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:07,506 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:15:07,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0e45f0314500ee387226e3ca4abd9d03, NAME => 'testtb-testEmptyExportFileSystemState,,1689232495186.0e45f0314500ee387226e3ca4abd9d03.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c32b8b15d57c7aa49cd4a5086961bf25, NAME => 'testtb-testEmptyExportFileSystemState,1,1689232495186.c32b8b15d57c7aa49cd4a5086961bf25.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:15:07,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-13 07:15:07,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232507506"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:07,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-13 07:15:07,513 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-13 07:15:07,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 52 msec 2023-07-13 07:15:07,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-13 07:15:07,571 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-13 07:15:07,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-13 07:15:07,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-13 07:15:07,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-13 07:15:07,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-13 07:15:07,613 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 756) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:39481 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:33565 from appattempt_1689232409308_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:40211 from appattempt_1689232409308_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:45288 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:35400 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4671 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-254845979_1 at /127.0.0.1:35380 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:57068 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=1857 (was 2494) 2023-07-13 07:15:07,613 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-13 07:15:07,634 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=173, AvailableMemoryMB=1856 2023-07-13 07:15:07,634 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-13 07:15:07,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-13 07:15:07,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:07,638 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-13 07:15:07,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-13 07:15:07,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-13 07:15:07,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:15:07,640 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,640 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,641 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 empty. 2023-07-13 07:15:07,641 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d empty. 2023-07-13 07:15:07,641 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,641 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,641 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 07:15:07,650 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-13 07:15:07,651 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 495d37fa214b40456f59aaebeb929961, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:15:07,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5bc880fc2f89bd3cd540074838ec0b2d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp 2023-07-13 07:15:07,663 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:07,663 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:07,663 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 495d37fa214b40456f59aaebeb929961, disabling compactions & flushes 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 5bc880fc2f89bd3cd540074838ec0b2d, disabling compactions & flushes 2023-07-13 07:15:07,664 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:07,664 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. after waiting 0 ms 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. after waiting 0 ms 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:07,664 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:07,664 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 495d37fa214b40456f59aaebeb929961: 2023-07-13 07:15:07,664 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 5bc880fc2f89bd3cd540074838ec0b2d: 2023-07-13 07:15:07,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-13 07:15:07,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232507667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232507667"}]},"ts":"1689232507667"} 2023-07-13 07:15:07,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232507667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232507667"}]},"ts":"1689232507667"} 2023-07-13 07:15:07,669 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-13 07:15:07,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-13 07:15:07,670 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232507670"}]},"ts":"1689232507670"} 2023-07-13 07:15:07,671 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-13 07:15:07,673 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-13 07:15:07,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-13 07:15:07,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-13 07:15:07,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-13 07:15:07,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-13 07:15:07,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, ASSIGN}] 2023-07-13 07:15:07,677 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, ASSIGN 2023-07-13 07:15:07,677 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, ASSIGN 2023-07-13 07:15:07,677 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44055,1689232402206; forceNewPlan=false, retain=false 2023-07-13 07:15:07,677 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38771,1689232402287; forceNewPlan=false, retain=false 2023-07-13 07:15:07,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:15:07,828 INFO [jenkins-hbase20:36645] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-13 07:15:07,831 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5bc880fc2f89bd3cd540074838ec0b2d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:07,831 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=495d37fa214b40456f59aaebeb929961, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:07,831 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232507831"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232507831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232507831"}]},"ts":"1689232507831"} 2023-07-13 07:15:07,832 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232507831"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232507831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232507831"}]},"ts":"1689232507831"} 2023-07-13 07:15:07,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 5bc880fc2f89bd3cd540074838ec0b2d, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:15:07,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 495d37fa214b40456f59aaebeb929961, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:15:07,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:15:07,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:07,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5bc880fc2f89bd3cd540074838ec0b2d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.', STARTKEY => '1', ENDKEY => ''} 2023-07-13 07:15:07,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:07,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 495d37fa214b40456f59aaebeb929961, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.', STARTKEY => '', ENDKEY => '1'} 2023-07-13 07:15:07,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. service=AccessControlService 2023-07-13 07:15:07,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. service=AccessControlService 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:07,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-13 07:15:07,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,996 INFO [StoreOpener-5bc880fc2f89bd3cd540074838ec0b2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:07,996 INFO [StoreOpener-495d37fa214b40456f59aaebeb929961-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:07,998 DEBUG [StoreOpener-5bc880fc2f89bd3cd540074838ec0b2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf 2023-07-13 07:15:07,998 DEBUG [StoreOpener-5bc880fc2f89bd3cd540074838ec0b2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf 2023-07-13 07:15:07,998 DEBUG [StoreOpener-495d37fa214b40456f59aaebeb929961-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf 2023-07-13 07:15:07,998 DEBUG [StoreOpener-495d37fa214b40456f59aaebeb929961-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf 2023-07-13 07:15:07,998 INFO [StoreOpener-495d37fa214b40456f59aaebeb929961-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 495d37fa214b40456f59aaebeb929961 columnFamilyName cf 2023-07-13 07:15:07,998 INFO [StoreOpener-5bc880fc2f89bd3cd540074838ec0b2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5bc880fc2f89bd3cd540074838ec0b2d columnFamilyName cf 2023-07-13 07:15:08,000 INFO [StoreOpener-5bc880fc2f89bd3cd540074838ec0b2d-1] regionserver.HStore(310): Store=5bc880fc2f89bd3cd540074838ec0b2d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:08,000 INFO [StoreOpener-495d37fa214b40456f59aaebeb929961-1] regionserver.HStore(310): Store=495d37fa214b40456f59aaebeb929961/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-13 07:15:08,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:08,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:08,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:08,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:08,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:08,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:08,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:08,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-13 07:15:08,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 495d37fa214b40456f59aaebeb929961; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64895758, jitterRate=-0.03297784924507141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:08,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5bc880fc2f89bd3cd540074838ec0b2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62983032, jitterRate=-0.06147968769073486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-13 07:15:08,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 495d37fa214b40456f59aaebeb929961: 2023-07-13 07:15:08,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5bc880fc2f89bd3cd540074838ec0b2d: 2023-07-13 07:15:08,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961., pid=109, masterSystemTime=1689232507986 2023-07-13 07:15:08,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d., pid=108, masterSystemTime=1689232507986 2023-07-13 07:15:08,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,007 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5bc880fc2f89bd3cd540074838ec0b2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,008 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232508007"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232508007"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232508007"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232508007"}]},"ts":"1689232508007"} 2023-07-13 07:15:08,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=495d37fa214b40456f59aaebeb929961, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232508008"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689232508008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689232508008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689232508008"}]},"ts":"1689232508008"} 2023-07-13 07:15:08,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-13 07:15:08,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-13 07:15:08,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 495d37fa214b40456f59aaebeb929961, server=jenkins-hbase20.apache.org,38771,1689232402287 in 174 msec 2023-07-13 07:15:08,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 5bc880fc2f89bd3cd540074838ec0b2d, server=jenkins-hbase20.apache.org,44055,1689232402206 in 175 msec 2023-07-13 07:15:08,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, ASSIGN in 336 msec 2023-07-13 07:15:08,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-13 07:15:08,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, ASSIGN in 336 msec 2023-07-13 07:15:08,012 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-13 07:15:08,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232508012"}]},"ts":"1689232508012"} 2023-07-13 07:15:08,013 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-13 07:15:08,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-13 07:15:08,015 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-13 07:15:08,016 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:15:08,017 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:08,017 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:08,017 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:08,017 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:08,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:08,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:08,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:08,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-13 07:15:08,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 383 msec 2023-07-13 07:15:08,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-13 07:15:08,244 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-13 07:15:08,247 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,247 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,249 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:08,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232508297 (current time:1689232508297). 2023-07-13 07:15:08,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:15:08,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x026298f8 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:08,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37e353d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:08,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,333 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x026298f8 to 127.0.0.1:61300 2023-07-13 07:15:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x47dc5802 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:08,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@516fbd59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:08,441 DEBUG [hconnection-0x7cbf0977-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,453 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,461 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47dc5802 to 127.0.0.1:61300 2023-07-13 07:15:08,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:08,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:15:08,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:15:08,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,466 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,466 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689233108466 2023-07-13 07:15:08,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,468 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:15:08,468 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:15:08,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:08,469 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-13 07:15:08,471 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:08,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689233108472 2023-07-13 07:15:08,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,481 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:15:08,481 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,482 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 07:15:08,482 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 07:15:08,483 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,483 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,487 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,487 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,487 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,487 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,488 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,489 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,489 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,489 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,489 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,491 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-13 07:15:08,492 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,492 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,492 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,493 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,493 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,493 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,496 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,497 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,497 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,497 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,498 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,498 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7af13568[Count = 1] remaining members to acquire global barrier 2023-07-13 07:15:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:15:08,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7af13568[Count = 0] remaining members to acquire global barrier 2023-07-13 07:15:08,502 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 07:15:08,502 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,503 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:08,504 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:08,503 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,504 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:15:08,503 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,503 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,503 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. started... 2023-07-13 07:15:08,504 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,504 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:15:08,504 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. started... 2023-07-13 07:15:08,504 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 495d37fa214b40456f59aaebeb929961: 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bc880fc2f89bd3cd540074838ec0b2d: 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,506 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:08,507 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-13 07:15:08,509 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,509 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,509 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,543 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. completed. 2023-07-13 07:15:08,543 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. completed. 2023-07-13 07:15:08,543 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,543 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:15:08,543 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:15:08,546 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,546 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,546 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,546 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,546 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,546 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,546 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,548 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:15:08,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 07:15:08,557 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 07:15:08,557 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:15:08,557 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:15:08,558 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,558 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,560 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,561 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,561 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,561 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,565 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,565 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,565 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,568 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:08,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:15:08,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:15:08,569 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:15:08,571 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,571 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,571 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,571 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,571 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,572 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,572 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,572 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,572 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,572 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,572 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,574 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,574 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:15:08,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,574 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-13 07:15:08,574 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,575 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,575 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,575 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 07:15:08,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,656 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689232508466Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689232508587 (+121 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232508587Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232508587Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232508591 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689232508605 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689232508655 (+50 ms) 2023-07-13 07:15:08,658 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:08,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 191 msec 2023-07-13 07:15:08,769 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:08,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:15:08,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:15:08,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38771] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:15:08,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44055] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-13 07:15:08,777 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,778 DEBUG [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,778 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-13 07:15:08,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689232508792 (current time:1689232508792). 2023-07-13 07:15:08,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-13 07:15:08,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x104a02d1 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:08,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143a551e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:08,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,803 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x104a02d1 to 127.0.0.1:61300 2023-07-13 07:15:08,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:08,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(139): Connect 0x7b5791b0 to 127.0.0.1:61300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-13 07:15:08,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bcb5881, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-13 07:15:08,819 DEBUG [hconnection-0x7d9f6843-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,823 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-13 07:15:08,835 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-13 07:15:08,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b5791b0 to 127.0.0.1:61300 2023-07-13 07:15:08,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:08,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-13 07:15:08,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-13 07:15:08,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,842 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,842 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689233108842 2023-07-13 07:15:08,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-13 07:15:08,845 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-13 07:15:08,846 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-13 07:15:08,846 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-13 07:15:08,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:08,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-13 07:15:08,848 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:08,849 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689233108849 2023-07-13 07:15:08,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,857 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:15:08,857 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,858 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-13 07:15:08,858 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-13 07:15:08,859 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,859 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,863 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,863 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,863 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,863 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,864 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,864 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-13 07:15:08,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,865 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,865 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,865 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-13 07:15:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,865 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-13 07:15:08,867 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,868 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-13 07:15:08,868 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,866 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,868 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,868 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46789,1689232402346' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,868 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-13 07:15:08,869 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-13 07:15:08,869 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,869 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,872 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,872 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44055,1689232402206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:15:08,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d54334d[Count = 1] remaining members to acquire global barrier 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38771,1689232402287' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-13 07:15:08,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d54334d[Count = 0] remaining members to acquire global barrier 2023-07-13 07:15:08,875 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-13 07:15:08,875 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,876 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,876 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,876 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-13 07:15:08,876 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. started... 2023-07-13 07:15:08,876 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-13 07:15:08,876 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,46789,1689232402346' in zk 2023-07-13 07:15:08,876 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 495d37fa214b40456f59aaebeb929961 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-13 07:15:08,876 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. started... 2023-07-13 07:15:08,877 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5bc880fc2f89bd3cd540074838ec0b2d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-13 07:15:08,877 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,877 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,877 DEBUG [member: 'jenkins-hbase20.apache.org,46789,1689232402346' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,904 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725 2023-07-13 07:15:08,904 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e 2023-07-13 07:15:08,914 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/.tmp/cf/a898505c64004ee298b7f68caad1a233 2023-07-13 07:15:08,914 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/.tmp/cf/4bb2b892b79249de8b9b0ba17bfcb308 2023-07-13 07:15:08,919 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/.tmp/cf/4bb2b892b79249de8b9b0ba17bfcb308 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308 2023-07-13 07:15:08,919 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/.tmp/cf/a898505c64004ee298b7f68caad1a233 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233 2023-07-13 07:15:08,923 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308, entries=47, sequenceid=6, filesize=13.3 K 2023-07-13 07:15:08,923 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233, entries=3, sequenceid=6, filesize=5.4 K 2023-07-13 07:15:08,923 INFO [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 495d37fa214b40456f59aaebeb929961 in 47ms, sequenceid=6, compaction requested=false 2023-07-13 07:15:08,924 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-13 07:15:08,924 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 495d37fa214b40456f59aaebeb929961: 2023-07-13 07:15:08,924 INFO [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5bc880fc2f89bd3cd540074838ec0b2d in 47ms, sequenceid=6, compaction requested=false 2023-07-13 07:15:08,924 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bc880fc2f89bd3cd540074838ec0b2d: 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233] hfiles 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308] hfiles 2023-07-13 07:15:08,926 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,944 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. completed. 2023-07-13 07:15:08,946 DEBUG [rs(jenkins-hbase20.apache.org,38771,1689232402287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:08,946 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:08,946 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:08,946 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,946 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,946 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38771,1689232402287' in zk 2023-07-13 07:15:08,946 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,947 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:15:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-13 07:15:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,38771,1689232402287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,949 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-13 07:15:08,949 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. completed. 2023-07-13 07:15:08,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,949 DEBUG [rs(jenkins-hbase20.apache.org,44055,1689232402206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:08,950 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-13 07:15:08,950 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-13 07:15:08,950 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,950 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-13 07:15:08,950 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,44055,1689232402206' in zk 2023-07-13 07:15:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,950 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,951 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-13 07:15:08,951 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,951 DEBUG [member: 'jenkins-hbase20.apache.org,44055,1689232402206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-13 07:15:08,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38771,1689232402287': 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38771,1689232402287' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,44055,1689232402206': 2023-07-13 07:15:08,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44055,1689232402206' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-13 07:15:08,956 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-13 07:15:08,957 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-13 07:15:08,957 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-13 07:15:08,957 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,957 INFO [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,967 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,968 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-13 07:15:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,968 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,969 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-13 07:15:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,970 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,970 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-13 07:15:08,970 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,975 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,975 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-13 07:15:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,976 DEBUG [(jenkins-hbase20.apache.org,36645,1689232400946)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-13 07:15:08,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-13 07:15:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-13 07:15:08,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,976 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:08,978 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-13 07:15:08,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-13 07:15:08,978 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:08,978 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:08,978 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,978 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725] mob files 2023-07-13 07:15:08,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e 2023-07-13 07:15:08,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725 2023-07-13 07:15:08,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:08,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-13 07:15:09,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,036 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689232508843Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689232508984 (+141 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689232508984Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689232508984Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689232508988 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689232509010 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689232509035 (+25 ms) 2023-07-13 07:15:09,039 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-13 07:15:09,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 195 msec 2023-07-13 07:15:09,149 DEBUG [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-13 07:15:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-13 07:15:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-13 07:15:09,151 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151 2023-07-13 07:15:09,151 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:42973, tgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151, rawTgtDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151, srcFsUri=hdfs://localhost.localdomain:42973, srcDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:15:09,170 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160 2023-07-13 07:15:09,171 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1534420055_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,171 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:42973, inputRoot=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160, snapshotDir=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-13 07:15:09,179 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:09,215 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,216 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,216 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,217 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,217 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,218 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,218 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,300 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/hadoop-1209518795859327016.jar 2023-07-13 07:15:09,301 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,301 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,302 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,302 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,303 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,303 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-13 07:15:09,304 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-13 07:15:09,304 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-13 07:15:09,304 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-13 07:15:09,305 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-13 07:15:09,305 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-13 07:15:09,306 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-13 07:15:09,306 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-13 07:15:09,307 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-13 07:15:09,307 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-13 07:15:09,308 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-13 07:15:09,308 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:09,309 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:09,309 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:09,309 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:09,310 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-13 07:15:09,323 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:09,323 DEBUG [Listener at jenkins-hbase20.apache.org/45007] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-13 07:15:10,875 WARN [Listener at jenkins-hbase20.apache.org/45007] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-13 07:15:10,877 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-13 07:15:10,879 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-13 07:15:11,844 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:15:11,844 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-13 07:15:11,853 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0006_000001 (auth:SIMPLE) 2023-07-13 07:15:11,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0007_000001 (auth:SIMPLE) 2023-07-13 07:15:12,954 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:15:17,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0007_000001 (auth:SIMPLE) 2023-07-13 07:15:19,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0007_000001 (auth:SIMPLE) 2023-07-13 07:15:24,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689232409308_0007_000001 (auth:SIMPLE) 2023-07-13 07:15:26,119 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-13 07:15:26,119 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-13 07:15:26,134 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,135 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-13 07:15:26,135 INFO [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-13 07:15:26,136 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,136 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 07:15:26,137 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 07:15:26,137 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-760059007_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,137 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-13 07:15:26,137 DEBUG [Listener at jenkins-hbase20.apache.org/45007] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/export-test/export-1689232509151/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-13 07:15:26,145 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:15:26,150 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232526150"}]},"ts":"1689232526150"} 2023-07-13 07:15:26,151 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-13 07:15:26,153 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-13 07:15:26,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, UNASSIGN}] 2023-07-13 07:15:26,157 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, UNASSIGN 2023-07-13 07:15:26,158 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, UNASSIGN 2023-07-13 07:15:26,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5bc880fc2f89bd3cd540074838ec0b2d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:26,160 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=495d37fa214b40456f59aaebeb929961, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:26,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232526160"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232526160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232526160"}]},"ts":"1689232526160"} 2023-07-13 07:15:26,160 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232526160"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689232526160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689232526160"}]},"ts":"1689232526160"} 2023-07-13 07:15:26,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 5bc880fc2f89bd3cd540074838ec0b2d, server=jenkins-hbase20.apache.org,44055,1689232402206}] 2023-07-13 07:15:26,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 495d37fa214b40456f59aaebeb929961, server=jenkins-hbase20.apache.org,38771,1689232402287}] 2023-07-13 07:15:26,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:15:26,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 495d37fa214b40456f59aaebeb929961, disabling compactions & flushes 2023-07-13 07:15:26,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. after waiting 0 ms 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:26,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5bc880fc2f89bd3cd540074838ec0b2d, disabling compactions & flushes 2023-07-13 07:15:26,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. after waiting 0 ms 2023-07-13 07:15:26,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:26,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:15:26,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:15:26,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:26,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961. 2023-07-13 07:15:26,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 495d37fa214b40456f59aaebeb929961: 2023-07-13 07:15:26,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:26,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d. 2023-07-13 07:15:26,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5bc880fc2f89bd3cd540074838ec0b2d: 2023-07-13 07:15:26,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:26,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=495d37fa214b40456f59aaebeb929961, regionState=CLOSED 2023-07-13 07:15:26,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232526347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232526347"}]},"ts":"1689232526347"} 2023-07-13 07:15:26,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:26,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5bc880fc2f89bd3cd540074838ec0b2d, regionState=CLOSED 2023-07-13 07:15:26,350 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689232526349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689232526349"}]},"ts":"1689232526349"} 2023-07-13 07:15:26,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-13 07:15:26,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 495d37fa214b40456f59aaebeb929961, server=jenkins-hbase20.apache.org,38771,1689232402287 in 187 msec 2023-07-13 07:15:26,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=495d37fa214b40456f59aaebeb929961, UNASSIGN in 198 msec 2023-07-13 07:15:26,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-13 07:15:26,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 5bc880fc2f89bd3cd540074838ec0b2d, server=jenkins-hbase20.apache.org,44055,1689232402206 in 190 msec 2023-07-13 07:15:26,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-13 07:15:26,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5bc880fc2f89bd3cd540074838ec0b2d, UNASSIGN in 200 msec 2023-07-13 07:15:26,367 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689232526367"}]},"ts":"1689232526367"} 2023-07-13 07:15:26,369 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-13 07:15:26,370 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-13 07:15:26,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 226 msec 2023-07-13 07:15:26,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-13 07:15:26,453 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-13 07:15:26,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,466 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,467 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46789] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,468 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,469 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:15:26,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:15:26,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:15:26,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,471 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:26,470 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-13 07:15:26,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 07:15:26,475 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:26,494 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/recovered.edits] 2023-07-13 07:15:26,494 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:26,503 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf, FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/recovered.edits] 2023-07-13 07:15:26,505 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/cf/a898505c64004ee298b7f68caad1a233 2023-07-13 07:15:26,509 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961/recovered.edits/9.seqid 2023-07-13 07:15:26,509 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/495d37fa214b40456f59aaebeb929961 2023-07-13 07:15:26,512 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/cf/4bb2b892b79249de8b9b0ba17bfcb308 2023-07-13 07:15:26,515 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/recovered.edits/9.seqid to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d/recovered.edits/9.seqid 2023-07-13 07:15:26,516 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5bc880fc2f89bd3cd540074838ec0b2d 2023-07-13 07:15:26,516 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-13 07:15:26,518 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-13 07:15:26,519 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-13 07:15:26,526 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307138bce76c60bee404cbd7f57a0fc66b84e 2023-07-13 07:15:26,529 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725 to hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230713e41d409918bd4f71970792020a28b725 2023-07-13 07:15:26,530 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-13 07:15:26,534 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,537 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-13 07:15:26,557 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-13 07:15:26,558 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,558 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-13 07:15:26,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232526558"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:26,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689232526558"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:26,561 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-13 07:15:26,561 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 495d37fa214b40456f59aaebeb929961, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689232507635.495d37fa214b40456f59aaebeb929961.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5bc880fc2f89bd3cd540074838ec0b2d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689232507635.5bc880fc2f89bd3cd540074838ec0b2d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-13 07:15:26,561 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-13 07:15:26,561 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689232526561"}]},"ts":"9223372036854775807"} 2023-07-13 07:15:26,574 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-13 07:15:26,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 07:15:26,576 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 122 msec 2023-07-13 07:15:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-13 07:15:26,777 INFO [Listener at jenkins-hbase20.apache.org/45007] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-13 07:15:26,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 07:15:26,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-13 07:15:26,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36645] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-13 07:15:26,813 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (974486456) connection to jenkins-hbase20.apache.org/148.251.75.209:42573 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:46328 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:53380 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61809ef1-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_862778499_1 at /127.0.0.1:53350 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5311 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-760059007_17 at /127.0.0.1:49788 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=472 (was 413) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 173), AvailableMemoryMB=1331 (was 1856) 2023-07-13 07:15:26,813 WARN [Listener at jenkins-hbase20.apache.org/45007] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-13 07:15:26,813 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-13 07:15:26,825 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:15:26,938 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689232409308_0007_01_000001 is : 143 2023-07-13 07:15:31,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-13 07:15:40,947 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:15:55,096 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:15:55,097 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:15:55,210 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-13 07:15:55,226 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-13 07:15:55,228 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:15:55,268 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-13 07:15:55,373 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-13 07:15:55,373 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-13 07:15:55,373 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-13 07:15:55,373 INFO [Listener at jenkins-hbase20.apache.org/45007] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-13 07:15:55,373 DEBUG [Listener at jenkins-hbase20.apache.org/45007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ee8aab0 to 127.0.0.1:61300 2023-07-13 07:15:55,373 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,374 DEBUG [Listener at jenkins-hbase20.apache.org/45007] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-13 07:15:55,374 DEBUG [Listener at jenkins-hbase20.apache.org/45007] util.JVMClusterUtil(257): Found active master hash=1183387750, stopped=false 2023-07-13 07:15:55,374 DEBUG [Listener at jenkins-hbase20.apache.org/45007] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,374 DEBUG [Listener at jenkins-hbase20.apache.org/45007] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-13 07:15:55,374 INFO [Listener at jenkins-hbase20.apache.org/45007] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:15:55,375 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:55,375 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:55,375 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:55,375 INFO [Listener at jenkins-hbase20.apache.org/45007] procedure2.ProcedureExecutor(629): Stopping 2023-07-13 07:15:55,375 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-13 07:15:55,375 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:55,375 DEBUG [Listener at jenkins-hbase20.apache.org/45007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x650e8b45 to 127.0.0.1:61300 2023-07-13 07:15:55,375 DEBUG [Listener at jenkins-hbase20.apache.org/45007] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:55,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:55,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:55,376 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44055,1689232402206' ***** 2023-07-13 07:15:55,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-13 07:15:55,377 DEBUG [Listener at jenkins-hbase20.apache.org/45007] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,377 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:15:55,377 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38771,1689232402287' ***** 2023-07-13 07:15:55,377 DEBUG [Listener at jenkins-hbase20.apache.org/45007] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,377 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:15:55,377 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,46789,1689232402346' ***** 2023-07-13 07:15:55,377 DEBUG [Listener at jenkins-hbase20.apache.org/45007] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,377 INFO [Listener at jenkins-hbase20.apache.org/45007] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-13 07:15:55,377 INFO [RS:1;jenkins-hbase20:38771] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:15:55,377 INFO [RS:2;jenkins-hbase20:46789] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:15:55,377 INFO [RS:1;jenkins-hbase20:38771] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:15:55,377 INFO [RS:0;jenkins-hbase20:44055] regionserver.HeapMemoryManager(220): Stopping 2023-07-13 07:15:55,378 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:15:55,378 INFO [RS:0;jenkins-hbase20:44055] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:15:55,378 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:15:55,378 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-13 07:15:55,378 INFO [RS:1;jenkins-hbase20:38771] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:15:55,377 INFO [RS:2;jenkins-hbase20:46789] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-13 07:15:55,378 INFO [RS:0;jenkins-hbase20:44055] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:15:55,378 INFO [RS:2;jenkins-hbase20:46789] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-13 07:15:55,378 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:55,378 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(3305): Received CLOSE for e203cb859309b901a2bd29bab56df89d 2023-07-13 07:15:55,378 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(3305): Received CLOSE for 233b830218999a25681bb89c531844dd 2023-07-13 07:15:55,378 DEBUG [RS:0;jenkins-hbase20:44055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a83f116 to 127.0.0.1:61300 2023-07-13 07:15:55,378 DEBUG [RS:0;jenkins-hbase20:44055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,381 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44055,1689232402206; all regions closed. 2023-07-13 07:15:55,381 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:55,382 DEBUG [RS:2;jenkins-hbase20:46789] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4324038e to 127.0.0.1:61300 2023-07-13 07:15:55,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e203cb859309b901a2bd29bab56df89d, disabling compactions & flushes 2023-07-13 07:15:55,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:15:55,382 DEBUG [RS:2;jenkins-hbase20:46789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:15:55,383 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:55,383 DEBUG [RS:1;jenkins-hbase20:38771] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dec1bd5 to 127.0.0.1:61300 2023-07-13 07:15:55,384 DEBUG [RS:1;jenkins-hbase20:38771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,383 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-13 07:15:55,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. after waiting 0 ms 2023-07-13 07:15:55,384 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1478): Online Regions={e203cb859309b901a2bd29bab56df89d=hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d.} 2023-07-13 07:15:55,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:15:55,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e203cb859309b901a2bd29bab56df89d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-13 07:15:55,384 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1504): Waiting on e203cb859309b901a2bd29bab56df89d 2023-07-13 07:15:55,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 233b830218999a25681bb89c531844dd, disabling compactions & flushes 2023-07-13 07:15:55,385 INFO [RS:1;jenkins-hbase20:38771] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:15:55,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:15:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:15:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. after waiting 0 ms 2023-07-13 07:15:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:15:55,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 233b830218999a25681bb89c531844dd 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-13 07:15:55,386 INFO [RS:1;jenkins-hbase20:38771] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:15:55,388 INFO [RS:1;jenkins-hbase20:38771] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:15:55,388 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-13 07:15:55,389 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-13 07:15:55,389 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1478): Online Regions={233b830218999a25681bb89c531844dd=hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd., 1588230740=hbase:meta,,1.1588230740} 2023-07-13 07:15:55,389 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1504): Waiting on 1588230740, 233b830218999a25681bb89c531844dd 2023-07-13 07:15:55,393 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-13 07:15:55,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-13 07:15:55,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-13 07:15:55,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-13 07:15:55,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-13 07:15:55,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-13 07:15:55,405 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:55,419 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:55,447 DEBUG [RS:0;jenkins-hbase20:44055] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs 2023-07-13 07:15:55,447 INFO [RS:0;jenkins-hbase20:44055] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44055%2C1689232402206:(num 1689232404345) 2023-07-13 07:15:55,448 DEBUG [RS:0;jenkins-hbase20:44055] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,448 INFO [RS:0;jenkins-hbase20:44055] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:55,450 INFO [RS:0;jenkins-hbase20:44055] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-13 07:15:55,451 INFO [RS:0;jenkins-hbase20:44055] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:15:55,451 INFO [RS:0;jenkins-hbase20:44055] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:15:55,451 INFO [RS:0;jenkins-hbase20:44055] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:15:55,451 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:15:55,472 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:55,490 INFO [RS:0;jenkins-hbase20:44055] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44055 2023-07-13 07:15:55,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/info/748202320b2946f9ab88f6ff2e8297a9 2023-07-13 07:15:55,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/.tmp/l/c4959f8704704a47894b0372f1bbcb10 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:55,529 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44055,1689232402206 2023-07-13 07:15:55,530 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:55,530 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44055,1689232402206] 2023-07-13 07:15:55,539 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44055,1689232402206; numProcessing=1 2023-07-13 07:15:55,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 748202320b2946f9ab88f6ff2e8297a9 2023-07-13 07:15:55,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4959f8704704a47894b0372f1bbcb10 2023-07-13 07:15:55,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/.tmp/l/c4959f8704704a47894b0372f1bbcb10 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/l/c4959f8704704a47894b0372f1bbcb10 2023-07-13 07:15:55,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4959f8704704a47894b0372f1bbcb10 2023-07-13 07:15:55,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/l/c4959f8704704a47894b0372f1bbcb10, entries=7, sequenceid=18, filesize=5.2 K 2023-07-13 07:15:55,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e203cb859309b901a2bd29bab56df89d in 198ms, sequenceid=18, compaction requested=false 2023-07-13 07:15:55,585 DEBUG [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1504): Waiting on e203cb859309b901a2bd29bab56df89d 2023-07-13 07:15:55,589 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1504): Waiting on 1588230740, 233b830218999a25681bb89c531844dd 2023-07-13 07:15:55,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/acl/e203cb859309b901a2bd29bab56df89d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-13 07:15:55,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/rep_barrier/1a0520a8690e42f984becf4487bb39d2 2023-07-13 07:15:55,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:15:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e203cb859309b901a2bd29bab56df89d: 2023-07-13 07:15:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689232405747.e203cb859309b901a2bd29bab56df89d. 2023-07-13 07:15:55,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a0520a8690e42f984becf4487bb39d2 2023-07-13 07:15:55,632 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:55,632 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:44055-0x100852d5b890001, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:55,632 INFO [RS:0;jenkins-hbase20:44055] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44055,1689232402206; zookeeper connection closed. 2023-07-13 07:15:55,636 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44055,1689232402206 already deleted, retry=false 2023-07-13 07:15:55,636 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,44055,1689232402206 expired; onlineServers=2 2023-07-13 07:15:55,638 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17ea3306] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17ea3306 2023-07-13 07:15:55,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/table/e17d3953e4454a86a19c77ef0c1ac902 2023-07-13 07:15:55,680 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e17d3953e4454a86a19c77ef0c1ac902 2023-07-13 07:15:55,681 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/info/748202320b2946f9ab88f6ff2e8297a9 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/info/748202320b2946f9ab88f6ff2e8297a9 2023-07-13 07:15:55,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 748202320b2946f9ab88f6ff2e8297a9 2023-07-13 07:15:55,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/info/748202320b2946f9ab88f6ff2e8297a9, entries=48, sequenceid=131, filesize=10.3 K 2023-07-13 07:15:55,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/rep_barrier/1a0520a8690e42f984becf4487bb39d2 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/rep_barrier/1a0520a8690e42f984becf4487bb39d2 2023-07-13 07:15:55,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a0520a8690e42f984becf4487bb39d2 2023-07-13 07:15:55,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/rep_barrier/1a0520a8690e42f984becf4487bb39d2, entries=13, sequenceid=131, filesize=6.4 K 2023-07-13 07:15:55,702 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/.tmp/table/e17d3953e4454a86a19c77ef0c1ac902 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/table/e17d3953e4454a86a19c77ef0c1ac902 2023-07-13 07:15:55,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e17d3953e4454a86a19c77ef0c1ac902 2023-07-13 07:15:55,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/table/e17d3953e4454a86a19c77ef0c1ac902, entries=24, sequenceid=131, filesize=6.9 K 2023-07-13 07:15:55,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 315ms, sequenceid=131, compaction requested=false 2023-07-13 07:15:55,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-13 07:15:55,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-13 07:15:55,765 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-13 07:15:55,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-13 07:15:55,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-13 07:15:55,785 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,46789,1689232402346; all regions closed. 2023-07-13 07:15:55,790 DEBUG [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1504): Waiting on 233b830218999a25681bb89c531844dd 2023-07-13 07:15:55,854 DEBUG [RS:2;jenkins-hbase20:46789] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs 2023-07-13 07:15:55,854 INFO [RS:2;jenkins-hbase20:46789] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46789%2C1689232402346:(num 1689232404345) 2023-07-13 07:15:55,854 DEBUG [RS:2;jenkins-hbase20:46789] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:55,854 INFO [RS:2;jenkins-hbase20:46789] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:55,854 INFO [RS:2;jenkins-hbase20:46789] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-13 07:15:55,855 INFO [RS:2;jenkins-hbase20:46789] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-13 07:15:55,855 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:15:55,856 INFO [RS:2;jenkins-hbase20:46789] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-13 07:15:55,856 INFO [RS:2;jenkins-hbase20:46789] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-13 07:15:55,857 INFO [RS:2;jenkins-hbase20:46789] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46789 2023-07-13 07:15:55,859 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:55,860 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:55,860 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46789,1689232402346 2023-07-13 07:15:55,860 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46789,1689232402346] 2023-07-13 07:15:55,860 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46789,1689232402346; numProcessing=2 2023-07-13 07:15:55,861 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46789,1689232402346 already deleted, retry=false 2023-07-13 07:15:55,861 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46789,1689232402346 expired; onlineServers=1 2023-07-13 07:15:55,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/.tmp/info/f1d6b50e6e9d42b0af8268bc481dee5f 2023-07-13 07:15:55,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/.tmp/info/f1d6b50e6e9d42b0af8268bc481dee5f as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/info/f1d6b50e6e9d42b0af8268bc481dee5f 2023-07-13 07:15:55,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/info/f1d6b50e6e9d42b0af8268bc481dee5f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-13 07:15:55,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 233b830218999a25681bb89c531844dd in 549ms, sequenceid=6, compaction requested=false 2023-07-13 07:15:55,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/data/hbase/namespace/233b830218999a25681bb89c531844dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-13 07:15:55,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-13 07:15:55,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:15:55,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 233b830218999a25681bb89c531844dd: 2023-07-13 07:15:55,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689232404883.233b830218999a25681bb89c531844dd. 2023-07-13 07:15:55,960 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:55,960 INFO [RS:2;jenkins-hbase20:46789] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,46789,1689232402346; zookeeper connection closed. 2023-07-13 07:15:55,960 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:46789-0x100852d5b890003, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:55,963 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b34747f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b34747f 2023-07-13 07:15:55,990 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38771,1689232402287; all regions closed. 2023-07-13 07:15:56,007 DEBUG [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs 2023-07-13 07:15:56,007 INFO [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38771%2C1689232402287.meta:.meta(num 1689232404535) 2023-07-13 07:15:56,040 DEBUG [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/oldWALs 2023-07-13 07:15:56,040 INFO [RS:1;jenkins-hbase20:38771] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38771%2C1689232402287:(num 1689232404345) 2023-07-13 07:15:56,040 DEBUG [RS:1;jenkins-hbase20:38771] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:56,040 INFO [RS:1;jenkins-hbase20:38771] regionserver.LeaseManager(133): Closed leases 2023-07-13 07:15:56,041 INFO [RS:1;jenkins-hbase20:38771] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-13 07:15:56,041 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:15:56,042 INFO [RS:1;jenkins-hbase20:38771] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38771 2023-07-13 07:15:56,043 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38771,1689232402287 2023-07-13 07:15:56,043 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-13 07:15:56,044 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38771,1689232402287] 2023-07-13 07:15:56,044 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38771,1689232402287; numProcessing=3 2023-07-13 07:15:56,045 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38771,1689232402287 already deleted, retry=false 2023-07-13 07:15:56,045 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38771,1689232402287 expired; onlineServers=0 2023-07-13 07:15:56,045 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36645,1689232400946' ***** 2023-07-13 07:15:56,045 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-13 07:15:56,045 DEBUG [M:0;jenkins-hbase20:36645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b41a5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-13 07:15:56,045 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36645,1689232400946 2023-07-13 07:15:56,045 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36645,1689232400946; all regions closed. 2023-07-13 07:15:56,045 DEBUG [M:0;jenkins-hbase20:36645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-13 07:15:56,046 DEBUG [M:0;jenkins-hbase20:36645] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-13 07:15:56,046 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-13 07:15:56,046 DEBUG [M:0;jenkins-hbase20:36645] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-13 07:15:56,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232403934] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689232403934,5,FailOnTimeoutGroup] 2023-07-13 07:15:56,046 INFO [M:0;jenkins-hbase20:36645] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-13 07:15:56,046 INFO [M:0;jenkins-hbase20:36645] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-13 07:15:56,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232403934] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689232403934,5,FailOnTimeoutGroup] 2023-07-13 07:15:56,046 INFO [M:0;jenkins-hbase20:36645] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-13 07:15:56,046 DEBUG [M:0;jenkins-hbase20:36645] master.HMaster(1512): Stopping service threads 2023-07-13 07:15:56,046 INFO [M:0;jenkins-hbase20:36645] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-13 07:15:56,047 ERROR [M:0;jenkins-hbase20:36645] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-13 07:15:56,047 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-13 07:15:56,047 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-13 07:15:56,048 INFO [M:0;jenkins-hbase20:36645] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-13 07:15:56,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-13 07:15:56,048 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-13 07:15:56,048 DEBUG [M:0;jenkins-hbase20:36645] zookeeper.ZKUtil(398): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-13 07:15:56,048 WARN [M:0;jenkins-hbase20:36645] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-13 07:15:56,048 INFO [M:0;jenkins-hbase20:36645] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-13 07:15:56,048 INFO [M:0;jenkins-hbase20:36645] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-13 07:15:56,049 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-13 07:15:56,049 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:56,049 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:56,049 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-13 07:15:56,049 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:56,050 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.28 KB heapSize=452.49 KB 2023-07-13 07:15:56,122 INFO [M:0;jenkins-hbase20:36645] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.28 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/64d37e281b234f9b94d88a892f3d44c9 2023-07-13 07:15:56,128 INFO [M:0;jenkins-hbase20:36645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d37e281b234f9b94d88a892f3d44c9 2023-07-13 07:15:56,129 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/64d37e281b234f9b94d88a892f3d44c9 as hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/64d37e281b234f9b94d88a892f3d44c9 2023-07-13 07:15:56,134 INFO [M:0;jenkins-hbase20:36645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d37e281b234f9b94d88a892f3d44c9 2023-07-13 07:15:56,135 INFO [M:0;jenkins-hbase20:36645] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42973/user/jenkins/test-data/08fbbb04-f4e1-47a8-8815-a325707d5160/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/64d37e281b234f9b94d88a892f3d44c9, entries=119, sequenceid=899, filesize=28.7 K 2023-07-13 07:15:56,136 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegion(2948): Finished flush of dataSize ~376.28 KB/385306, heapSize ~452.48 KB/463336, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 86ms, sequenceid=899, compaction requested=false 2023-07-13 07:15:56,142 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-13 07:15:56,142 DEBUG [M:0;jenkins-hbase20:36645] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-13 07:15:56,144 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:56,144 INFO [RS:1;jenkins-hbase20:38771] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38771,1689232402287; zookeeper connection closed. 2023-07-13 07:15:56,144 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): regionserver:38771-0x100852d5b890002, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:56,148 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2268da28] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2268da28 2023-07-13 07:15:56,148 INFO [Listener at jenkins-hbase20.apache.org/45007] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-13 07:15:56,156 INFO [M:0;jenkins-hbase20:36645] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-13 07:15:56,156 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-13 07:15:56,158 INFO [M:0;jenkins-hbase20:36645] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36645 2023-07-13 07:15:56,159 DEBUG [M:0;jenkins-hbase20:36645] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,36645,1689232400946 already deleted, retry=false 2023-07-13 07:15:56,260 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:56,260 DEBUG [Listener at localhost.localdomain/36337-EventThread] zookeeper.ZKWatcher(600): master:36645-0x100852d5b890000, quorum=127.0.0.1:61300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-13 07:15:56,260 INFO [M:0;jenkins-hbase20:36645] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36645,1689232400946; zookeeper connection closed. 2023-07-13 07:15:56,263 WARN [Listener at jenkins-hbase20.apache.org/45007] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:15:56,301 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:15:56,303 WARN [1345232591@qtp-918875199-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32961] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-13 07:15:56,303 WARN [1345232591@qtp-918875199-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32961] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-13 07:15:56,316 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:15:56,316 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-230923090-148.251.75.209-1689232397005 (Datanode Uuid efa08b05-20ce-44a2-bf70-9c6c5f7410d6) service to localhost.localdomain/127.0.0.1:42973 2023-07-13 07:15:56,318 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data5/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,323 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data6/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,335 WARN [Listener at jenkins-hbase20.apache.org/45007] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:15:56,349 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:15:56,350 WARN [886559757@qtp-267674392-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41057] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-13 07:15:56,350 WARN [886559757@qtp-267674392-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41057] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-13 07:15:56,452 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:15:56,452 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-230923090-148.251.75.209-1689232397005 (Datanode Uuid 4f0d2746-6221-497b-bfc3-dde203fa3751) service to localhost.localdomain/127.0.0.1:42973 2023-07-13 07:15:56,453 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data3/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,454 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data4/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,456 WARN [Listener at jenkins-hbase20.apache.org/45007] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-13 07:15:56,474 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-13 07:15:56,578 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-13 07:15:56,578 WARN [BP-230923090-148.251.75.209-1689232397005 heartbeating to localhost.localdomain/127.0.0.1:42973] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-230923090-148.251.75.209-1689232397005 (Datanode Uuid 1a22c73d-f2f1-4d11-a101-aef5e664738a) service to localhost.localdomain/127.0.0.1:42973 2023-07-13 07:15:56,579 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data1/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,579 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ff81ad9d-3468-84a8-6068-a430f43d2553/cluster_20d9bad5-b49f-e03b-9f34-34eba061a5e8/dfs/data/data2/current/BP-230923090-148.251.75.209-1689232397005] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-13 07:15:56,647 INFO [Listener at jenkins-hbase20.apache.org/45007] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-13 07:15:56,688 INFO [Listener at jenkins-hbase20.apache.org/45007] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-13 07:15:56,822 INFO [Listener at jenkins-hbase20.apache.org/45007] hbase.HBaseTestingUtility(1293): Minicluster is down