2023-07-14 18:10:39,929 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 18:10:40,136 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91 2023-07-14 18:10:40,136 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-14 18:10:40,137 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-14 18:10:40,177 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 18:10:40,405 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 18:10:40,405 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2, deleteOnExit=true 2023-07-14 18:10:40,406 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 18:10:40,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/test.cache.data in system properties and HBase conf 2023-07-14 18:10:40,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 18:10:40,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop.log.dir in system properties and HBase conf 2023-07-14 18:10:40,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 18:10:40,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 18:10:40,409 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 18:10:40,725 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 18:10:40,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 18:10:40,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 18:10:40,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 18:10:40,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 18:10:40,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 18:10:40,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 18:10:40,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 18:10:40,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 18:10:40,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 18:10:40,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/nfs.dump.dir in system properties and HBase conf 2023-07-14 18:10:40,736 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir in system properties and HBase conf 2023-07-14 18:10:40,736 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 18:10:40,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 18:10:40,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 18:10:41,293 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 18:10:41,297 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 18:10:41,557 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 18:10:41,763 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 18:10:41,780 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:41,825 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:41,863 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_localhost_localdomain_46877_hdfs____fermsw/webapp 2023-07-14 18:10:42,005 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:46877 2023-07-14 18:10:42,038 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 18:10:42,039 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 18:10:42,648 WARN [Listener at localhost.localdomain/46427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 18:10:42,775 WARN [Listener at localhost.localdomain/46427] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 18:10:42,800 WARN [Listener at localhost.localdomain/46427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:42,808 INFO [Listener at localhost.localdomain/46427] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:42,817 INFO [Listener at localhost.localdomain/46427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_localhost_44153_datanode____iytoqe/webapp 2023-07-14 18:10:42,937 INFO [Listener at localhost.localdomain/46427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44153 2023-07-14 18:10:43,436 WARN [Listener at localhost.localdomain/40909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 18:10:43,457 WARN [Listener at localhost.localdomain/40909] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 18:10:43,462 WARN [Listener at localhost.localdomain/40909] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:43,465 INFO [Listener at localhost.localdomain/40909] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:43,477 INFO [Listener at localhost.localdomain/40909] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_localhost_41217_datanode____c8e6jm/webapp 2023-07-14 18:10:43,595 INFO [Listener at localhost.localdomain/40909] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41217 2023-07-14 18:10:43,618 WARN [Listener at localhost.localdomain/40959] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 18:10:43,679 WARN [Listener at localhost.localdomain/40959] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 18:10:43,686 WARN [Listener at localhost.localdomain/40959] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:43,688 INFO [Listener at localhost.localdomain/40959] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:43,703 INFO [Listener at localhost.localdomain/40959] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_localhost_46185_datanode____.wpg9nx/webapp 2023-07-14 18:10:43,834 INFO [Listener at localhost.localdomain/40959] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46185 2023-07-14 18:10:43,870 WARN [Listener at localhost.localdomain/41397] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 18:10:44,043 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf86578ffffe1b3c2: Processing first storage report for DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad from datanode 832531d2-ecf5-4cc1-9288-2b21ff1fe7cc 2023-07-14 18:10:44,045 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf86578ffffe1b3c2: from storage DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad node DatanodeRegistration(127.0.0.1:42179, datanodeUuid=832531d2-ecf5-4cc1-9288-2b21ff1fe7cc, infoPort=36657, infoSecurePort=0, ipcPort=40909, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,046 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xba1c7ed1064d586e: Processing first storage report for DS-4fa16d51-6cee-4617-a5b3-8600402caabf from datanode 2ac85d13-978f-4d1f-93ba-4fe2c818686e 2023-07-14 18:10:44,046 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xba1c7ed1064d586e: from storage DS-4fa16d51-6cee-4617-a5b3-8600402caabf node DatanodeRegistration(127.0.0.1:33225, datanodeUuid=2ac85d13-978f-4d1f-93ba-4fe2c818686e, infoPort=44695, infoSecurePort=0, ipcPort=40959, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,046 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf86578ffffe1b3c2: Processing first storage report for DS-8d677982-4664-4890-bc42-565906be3238 from datanode 832531d2-ecf5-4cc1-9288-2b21ff1fe7cc 2023-07-14 18:10:44,047 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf86578ffffe1b3c2: from storage DS-8d677982-4664-4890-bc42-565906be3238 node DatanodeRegistration(127.0.0.1:42179, datanodeUuid=832531d2-ecf5-4cc1-9288-2b21ff1fe7cc, infoPort=36657, infoSecurePort=0, ipcPort=40909, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,047 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xba1c7ed1064d586e: Processing first storage report for DS-41035497-eb84-4fef-ad51-8102cbdb366a from datanode 2ac85d13-978f-4d1f-93ba-4fe2c818686e 2023-07-14 18:10:44,047 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xba1c7ed1064d586e: from storage DS-41035497-eb84-4fef-ad51-8102cbdb366a node DatanodeRegistration(127.0.0.1:33225, datanodeUuid=2ac85d13-978f-4d1f-93ba-4fe2c818686e, infoPort=44695, infoSecurePort=0, ipcPort=40959, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3e3c22005c5a623: Processing first storage report for DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722 from datanode a0eef9ef-e118-4d97-a943-d4c59c5548da 2023-07-14 18:10:44,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3e3c22005c5a623: from storage DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722 node DatanodeRegistration(127.0.0.1:42633, datanodeUuid=a0eef9ef-e118-4d97-a943-d4c59c5548da, infoPort=43745, infoSecurePort=0, ipcPort=41397, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3e3c22005c5a623: Processing first storage report for DS-7147cbd0-e98f-44bd-8674-c79ce28b5f3b from datanode a0eef9ef-e118-4d97-a943-d4c59c5548da 2023-07-14 18:10:44,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3e3c22005c5a623: from storage DS-7147cbd0-e98f-44bd-8674-c79ce28b5f3b node DatanodeRegistration(127.0.0.1:42633, datanodeUuid=a0eef9ef-e118-4d97-a943-d4c59c5548da, infoPort=43745, infoSecurePort=0, ipcPort=41397, storageInfo=lv=-57;cid=testClusterID;nsid=1819267829;c=1689358241361), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 18:10:44,335 DEBUG [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91 2023-07-14 18:10:44,425 INFO [Listener at localhost.localdomain/41397] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/zookeeper_0, clientPort=57638, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 18:10:44,445 INFO [Listener at localhost.localdomain/41397] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57638 2023-07-14 18:10:44,457 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:44,460 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:45,093 INFO [Listener at localhost.localdomain/41397] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 with version=8 2023-07-14 18:10:45,093 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/hbase-staging 2023-07-14 18:10:45,432 INFO [Listener at localhost.localdomain/41397] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 18:10:45,893 INFO [Listener at localhost.localdomain/41397] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-14 18:10:45,933 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:45,934 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:45,934 INFO [Listener at localhost.localdomain/41397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 18:10:45,934 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:45,935 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 18:10:46,079 INFO [Listener at localhost.localdomain/41397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 18:10:46,167 DEBUG [Listener at localhost.localdomain/41397] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 18:10:46,269 INFO [Listener at localhost.localdomain/41397] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44973 2023-07-14 18:10:46,283 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,286 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,311 INFO [Listener at localhost.localdomain/41397] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44973 connecting to ZooKeeper ensemble=127.0.0.1:57638 2023-07-14 18:10:46,374 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:449730x0, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 18:10:46,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44973-0x1008cad96b10000 connected 2023-07-14 18:10:46,437 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 18:10:46,438 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:10:46,451 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 18:10:46,463 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44973 2023-07-14 18:10:46,467 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44973 2023-07-14 18:10:46,472 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44973 2023-07-14 18:10:46,474 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44973 2023-07-14 18:10:46,474 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44973 2023-07-14 18:10:46,482 INFO [Listener at localhost.localdomain/41397] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, hbase.cluster.distributed=false 2023-07-14 18:10:46,539 INFO [Listener at localhost.localdomain/41397] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-14 18:10:46,539 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,540 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,540 INFO [Listener at localhost.localdomain/41397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 18:10:46,540 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,540 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 18:10:46,544 INFO [Listener at localhost.localdomain/41397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 18:10:46,547 INFO [Listener at localhost.localdomain/41397] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38741 2023-07-14 18:10:46,550 INFO [Listener at localhost.localdomain/41397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 18:10:46,557 INFO [Listener at localhost.localdomain/41397] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 18:10:46,558 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,560 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,562 INFO [Listener at localhost.localdomain/41397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38741 connecting to ZooKeeper ensemble=127.0.0.1:57638 2023-07-14 18:10:46,569 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:387410x0, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 18:10:46,570 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:387410x0, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 18:10:46,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38741-0x1008cad96b10001 connected 2023-07-14 18:10:46,572 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:10:46,573 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 18:10:46,575 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38741 2023-07-14 18:10:46,577 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38741 2023-07-14 18:10:46,578 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38741 2023-07-14 18:10:46,582 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38741 2023-07-14 18:10:46,584 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38741 2023-07-14 18:10:46,600 INFO [Listener at localhost.localdomain/41397] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-14 18:10:46,600 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,600 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,601 INFO [Listener at localhost.localdomain/41397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 18:10:46,601 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,602 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 18:10:46,602 INFO [Listener at localhost.localdomain/41397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 18:10:46,604 INFO [Listener at localhost.localdomain/41397] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34403 2023-07-14 18:10:46,604 INFO [Listener at localhost.localdomain/41397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 18:10:46,606 INFO [Listener at localhost.localdomain/41397] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 18:10:46,606 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,609 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,612 INFO [Listener at localhost.localdomain/41397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34403 connecting to ZooKeeper ensemble=127.0.0.1:57638 2023-07-14 18:10:46,616 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:344030x0, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 18:10:46,618 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:344030x0, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 18:10:46,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34403-0x1008cad96b10002 connected 2023-07-14 18:10:46,619 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:10:46,620 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 18:10:46,623 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34403 2023-07-14 18:10:46,623 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34403 2023-07-14 18:10:46,624 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34403 2023-07-14 18:10:46,627 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34403 2023-07-14 18:10:46,627 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34403 2023-07-14 18:10:46,639 INFO [Listener at localhost.localdomain/41397] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 18:10:46,640 INFO [Listener at localhost.localdomain/41397] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 18:10:46,642 INFO [Listener at localhost.localdomain/41397] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34151 2023-07-14 18:10:46,643 INFO [Listener at localhost.localdomain/41397] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 18:10:46,644 INFO [Listener at localhost.localdomain/41397] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 18:10:46,646 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,647 INFO [Listener at localhost.localdomain/41397] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,648 INFO [Listener at localhost.localdomain/41397] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34151 connecting to ZooKeeper ensemble=127.0.0.1:57638 2023-07-14 18:10:46,653 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:341510x0, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 18:10:46,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34151-0x1008cad96b10003 connected 2023-07-14 18:10:46,655 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 18:10:46,656 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:10:46,657 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 18:10:46,658 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34151 2023-07-14 18:10:46,659 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34151 2023-07-14 18:10:46,659 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34151 2023-07-14 18:10:46,662 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34151 2023-07-14 18:10:46,663 DEBUG [Listener at localhost.localdomain/41397] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34151 2023-07-14 18:10:46,668 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:46,677 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 18:10:46,679 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:46,698 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 18:10:46,698 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 18:10:46,698 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 18:10:46,698 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 18:10:46,699 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:46,700 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 18:10:46,701 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44973,1689358245251 from backup master directory 2023-07-14 18:10:46,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 18:10:46,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:46,708 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 18:10:46,708 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 18:10:46,709 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:46,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 18:10:46,715 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 18:10:46,878 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/hbase.id with ID: f13c5700-49c5-4ae5-8328-bb6bf535bc32 2023-07-14 18:10:46,941 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 18:10:46,963 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:47,083 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x58a5928a to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:47,129 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25972330, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:47,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 18:10:47,159 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 18:10:47,178 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 18:10:47,178 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 18:10:47,180 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 18:10:47,184 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 18:10:47,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 18:10:47,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store-tmp 2023-07-14 18:10:47,280 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:47,280 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 18:10:47,280 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:10:47,281 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:10:47,281 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 18:10:47,281 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:10:47,281 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:10:47,281 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 18:10:47,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/WALs/jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:47,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44973%2C1689358245251, suffix=, logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/WALs/jenkins-hbase20.apache.org,44973,1689358245251, archiveDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/oldWALs, maxLogs=10 2023-07-14 18:10:47,365 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK] 2023-07-14 18:10:47,365 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK] 2023-07-14 18:10:47,365 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK] 2023-07-14 18:10:47,374 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 18:10:47,456 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/WALs/jenkins-hbase20.apache.org,44973,1689358245251/jenkins-hbase20.apache.org%2C44973%2C1689358245251.1689358247320 2023-07-14 18:10:47,466 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK], DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK], DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK]] 2023-07-14 18:10:47,467 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 18:10:47,468 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:47,472 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,474 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,590 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,609 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 18:10:47,647 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 18:10:47,663 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:47,671 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 18:10:47,702 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:47,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69762573, jitterRate=0.03954334557056427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:10:47,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 18:10:47,704 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 18:10:47,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 18:10:47,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 18:10:47,737 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 18:10:47,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 18:10:47,785 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 45 msec 2023-07-14 18:10:47,785 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 18:10:47,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 18:10:47,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 18:10:47,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 18:10:47,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 18:10:47,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 18:10:47,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 18:10:47,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 18:10:47,895 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:47,900 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 18:10:47,900 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 18:10:47,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 18:10:47,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 18:10:47,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 18:10:47,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 18:10:47,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 18:10:47,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:47,923 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44973,1689358245251, sessionid=0x1008cad96b10000, setting cluster-up flag (Was=false) 2023-07-14 18:10:47,939 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:47,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 18:10:47,944 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:47,956 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:47,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 18:10:47,961 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:47,963 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp 2023-07-14 18:10:47,970 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(951): ClusterId : f13c5700-49c5-4ae5-8328-bb6bf535bc32 2023-07-14 18:10:47,978 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(951): ClusterId : f13c5700-49c5-4ae5-8328-bb6bf535bc32 2023-07-14 18:10:47,984 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(951): ClusterId : f13c5700-49c5-4ae5-8328-bb6bf535bc32 2023-07-14 18:10:47,993 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 18:10:47,993 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 18:10:47,993 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 18:10:47,999 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 18:10:47,999 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 18:10:47,999 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 18:10:47,999 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 18:10:47,999 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 18:10:47,999 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 18:10:48,013 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 18:10:48,015 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ReadOnlyZKClient(139): Connect 0x4daa0065 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:48,019 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 18:10:48,028 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 18:10:48,029 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ReadOnlyZKClient(139): Connect 0x3f5d11ef to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:48,031 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ReadOnlyZKClient(139): Connect 0x18091aca to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:48,035 DEBUG [RS:2;jenkins-hbase20:34151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73da5828, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:48,036 DEBUG [RS:2;jenkins-hbase20:34151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c44ca8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-14 18:10:48,062 DEBUG [RS:1;jenkins-hbase20:34403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fa499f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:48,063 DEBUG [RS:0;jenkins-hbase20:38741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dca01df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:48,063 DEBUG [RS:1;jenkins-hbase20:34403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6077dd59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-14 18:10:48,063 DEBUG [RS:0;jenkins-hbase20:38741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d673b13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-14 18:10:48,077 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:34403 2023-07-14 18:10:48,078 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:34151 2023-07-14 18:10:48,078 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:38741 2023-07-14 18:10:48,085 INFO [RS:1;jenkins-hbase20:34403] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 18:10:48,085 INFO [RS:1;jenkins-hbase20:34403] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 18:10:48,085 INFO [RS:0;jenkins-hbase20:38741] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 18:10:48,086 INFO [RS:0;jenkins-hbase20:38741] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 18:10:48,086 INFO [RS:2;jenkins-hbase20:34151] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 18:10:48,087 INFO [RS:2;jenkins-hbase20:34151] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 18:10:48,097 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 18:10:48,097 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 18:10:48,097 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 18:10:48,097 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 18:10:48,099 INFO [RS:2;jenkins-hbase20:34151] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:48,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:48,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 18:10:48,099 INFO [RS:0;jenkins-hbase20:38741] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:48,101 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 18:10:48,099 INFO [RS:1;jenkins-hbase20:34403] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:48,101 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 18:10:48,100 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 18:10:48,104 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:34403, startcode=1689358246599 2023-07-14 18:10:48,104 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:38741, startcode=1689358246539 2023-07-14 18:10:48,104 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:34151, startcode=1689358246638 2023-07-14 18:10:48,143 DEBUG [RS:1;jenkins-hbase20:34403] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 18:10:48,144 DEBUG [RS:0;jenkins-hbase20:38741] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 18:10:48,143 DEBUG [RS:2;jenkins-hbase20:34151] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 18:10:48,201 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 18:10:48,201 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40809, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 18:10:48,201 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34369, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 18:10:48,211 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 18:10:48,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 18:10:48,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 18:10:48,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-14 18:10:48,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,248 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689358278248 2023-07-14 18:10:48,251 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 18:10:48,251 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 18:10:48,252 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 18:10:48,255 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 18:10:48,255 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 18:10:48,255 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 18:10:48,256 WARN [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 18:10:48,256 WARN [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 18:10:48,256 WARN [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 18:10:48,257 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 18:10:48,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 18:10:48,270 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 18:10:48,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 18:10:48,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 18:10:48,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 18:10:48,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,273 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 18:10:48,276 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 18:10:48,276 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 18:10:48,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 18:10:48,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 18:10:48,289 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689358248286,5,FailOnTimeoutGroup] 2023-07-14 18:10:48,289 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689358248289,5,FailOnTimeoutGroup] 2023-07-14 18:10:48,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 18:10:48,290 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,312 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 18:10:48,313 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 18:10:48,313 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:48,346 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:48,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 18:10:48,357 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:34403, startcode=1689358246599 2023-07-14 18:10:48,357 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:38741, startcode=1689358246539 2023-07-14 18:10:48,357 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44973,1689358245251 with isa=jenkins-hbase20.apache.org/148.251.75.209:34151, startcode=1689358246638 2023-07-14 18:10:48,363 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/info 2023-07-14 18:10:48,365 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 18:10:48,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:48,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 18:10:48,369 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,371 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:48,371 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46427 2023-07-14 18:10:48,371 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 18:10:48,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/rep_barrier 2023-07-14 18:10:48,372 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44973] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 18:10:48,375 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:48,375 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46427 2023-07-14 18:10:48,375 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 18:10:48,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:48,377 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 18:10:48,378 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:48,378 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46427 2023-07-14 18:10:48,378 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 18:10:48,381 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ZKUtil(162): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,381 WARN [RS:0;jenkins-hbase20:38741] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 18:10:48,382 INFO [RS:0;jenkins-hbase20:38741] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 18:10:48,382 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,383 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:10:48,383 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ZKUtil(162): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,383 WARN [RS:2;jenkins-hbase20:34151] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 18:10:48,384 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/table 2023-07-14 18:10:48,385 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 18:10:48,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:48,384 INFO [RS:2;jenkins-hbase20:34151] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 18:10:48,390 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,389 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740 2023-07-14 18:10:48,391 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ZKUtil(162): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,391 WARN [RS:1;jenkins-hbase20:34403] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 18:10:48,391 INFO [RS:1;jenkins-hbase20:34403] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 18:10:48,392 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,392 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740 2023-07-14 18:10:48,395 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38741,1689358246539] 2023-07-14 18:10:48,396 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34403,1689358246599] 2023-07-14 18:10:48,396 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34151,1689358246638] 2023-07-14 18:10:48,409 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 18:10:48,412 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 18:10:48,436 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:48,438 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71956934, jitterRate=0.072241872549057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 18:10:48,438 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ZKUtil(162): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,438 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ZKUtil(162): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,438 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 18:10:48,438 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 18:10:48,438 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 18:10:48,438 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 18:10:48,439 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 18:10:48,439 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 18:10:48,439 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ZKUtil(162): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,439 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ZKUtil(162): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,440 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 18:10:48,440 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 18:10:48,446 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 18:10:48,446 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 18:10:48,447 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ZKUtil(162): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,448 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ZKUtil(162): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,449 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ZKUtil(162): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,451 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ZKUtil(162): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,458 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ZKUtil(162): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 18:10:48,468 DEBUG [RS:0;jenkins-hbase20:38741] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 18:10:48,475 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 18:10:48,468 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 18:10:48,488 INFO [RS:1;jenkins-hbase20:34403] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 18:10:48,488 INFO [RS:2;jenkins-hbase20:34151] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 18:10:48,491 INFO [RS:0;jenkins-hbase20:38741] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 18:10:48,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 18:10:48,499 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 18:10:48,520 INFO [RS:1;jenkins-hbase20:34403] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 18:10:48,527 INFO [RS:0;jenkins-hbase20:38741] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 18:10:48,531 INFO [RS:0;jenkins-hbase20:38741] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 18:10:48,531 INFO [RS:2;jenkins-hbase20:34151] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 18:10:48,531 INFO [RS:1;jenkins-hbase20:34403] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 18:10:48,532 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,533 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,535 INFO [RS:2;jenkins-hbase20:34151] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 18:10:48,535 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,542 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 18:10:48,542 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 18:10:48,542 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 18:10:48,557 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,557 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,557 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,558 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,559 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,559 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,559 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,560 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-14 18:10:48,560 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-14 18:10:48,561 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:2;jenkins-hbase20:34151] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,558 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:0;jenkins-hbase20:38741] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,561 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,562 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-14 18:10:48,562 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,563 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,563 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,563 DEBUG [RS:1;jenkins-hbase20:34403] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-14 18:10:48,566 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,566 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,573 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,574 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,574 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,574 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,578 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,579 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,579 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,592 INFO [RS:2;jenkins-hbase20:34151] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 18:10:48,594 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34151,1689358246638-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,593 INFO [RS:0;jenkins-hbase20:38741] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 18:10:48,596 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38741,1689358246539-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,620 INFO [RS:1;jenkins-hbase20:34403] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 18:10:48,620 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34403,1689358246599-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:48,626 INFO [RS:2;jenkins-hbase20:34151] regionserver.Replication(203): jenkins-hbase20.apache.org,34151,1689358246638 started 2023-07-14 18:10:48,627 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34151,1689358246638, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34151, sessionid=0x1008cad96b10003 2023-07-14 18:10:48,629 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 18:10:48,629 DEBUG [RS:2;jenkins-hbase20:34151] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,629 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34151,1689358246638' 2023-07-14 18:10:48,629 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 18:10:48,631 INFO [RS:0;jenkins-hbase20:38741] regionserver.Replication(203): jenkins-hbase20.apache.org,38741,1689358246539 started 2023-07-14 18:10:48,632 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38741,1689358246539, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38741, sessionid=0x1008cad96b10001 2023-07-14 18:10:48,632 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 18:10:48,632 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 18:10:48,632 DEBUG [RS:0;jenkins-hbase20:38741] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,636 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38741,1689358246539' 2023-07-14 18:10:48,636 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 18:10:48,636 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 18:10:48,637 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 18:10:48,637 DEBUG [RS:2;jenkins-hbase20:34151] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,637 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34151,1689358246638' 2023-07-14 18:10:48,637 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:48,640 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 18:10:48,640 DEBUG [RS:2;jenkins-hbase20:34151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:48,641 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 18:10:48,641 DEBUG [RS:2;jenkins-hbase20:34151] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 18:10:48,641 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 18:10:48,641 INFO [RS:2;jenkins-hbase20:34151] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 18:10:48,641 DEBUG [RS:0;jenkins-hbase20:38741] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:48,642 INFO [RS:2;jenkins-hbase20:34151] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 18:10:48,642 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38741,1689358246539' 2023-07-14 18:10:48,642 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:48,643 DEBUG [RS:0;jenkins-hbase20:38741] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:48,643 DEBUG [RS:0;jenkins-hbase20:38741] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 18:10:48,644 INFO [RS:0;jenkins-hbase20:38741] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 18:10:48,644 INFO [RS:0;jenkins-hbase20:38741] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 18:10:48,651 DEBUG [jenkins-hbase20:44973] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 18:10:48,658 DEBUG [jenkins-hbase20:44973] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:10:48,666 DEBUG [jenkins-hbase20:44973] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:10:48,666 DEBUG [jenkins-hbase20:44973] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:10:48,666 DEBUG [jenkins-hbase20:44973] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:10:48,666 DEBUG [jenkins-hbase20:44973] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:10:48,666 INFO [RS:1;jenkins-hbase20:34403] regionserver.Replication(203): jenkins-hbase20.apache.org,34403,1689358246599 started 2023-07-14 18:10:48,666 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,34403,1689358246599, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34403, sessionid=0x1008cad96b10002 2023-07-14 18:10:48,667 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 18:10:48,667 DEBUG [RS:1;jenkins-hbase20:34403] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,667 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34403,1689358246599' 2023-07-14 18:10:48,667 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 18:10:48,668 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 18:10:48,669 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 18:10:48,669 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 18:10:48,669 DEBUG [RS:1;jenkins-hbase20:34403] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:48,669 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34403,1689358246599' 2023-07-14 18:10:48,669 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:48,670 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34151,1689358246638, state=OPENING 2023-07-14 18:10:48,671 DEBUG [RS:1;jenkins-hbase20:34403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:48,673 DEBUG [RS:1;jenkins-hbase20:34403] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 18:10:48,673 INFO [RS:1;jenkins-hbase20:34403] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 18:10:48,673 INFO [RS:1;jenkins-hbase20:34403] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 18:10:48,679 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 18:10:48,680 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:48,682 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 18:10:48,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:10:48,758 INFO [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34151%2C1689358246638, suffix=, logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34151,1689358246638, archiveDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs, maxLogs=32 2023-07-14 18:10:48,759 INFO [RS:0;jenkins-hbase20:38741] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38741%2C1689358246539, suffix=, logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,38741,1689358246539, archiveDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs, maxLogs=32 2023-07-14 18:10:48,777 INFO [RS:1;jenkins-hbase20:34403] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34403%2C1689358246599, suffix=, logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34403,1689358246599, archiveDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs, maxLogs=32 2023-07-14 18:10:48,798 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK] 2023-07-14 18:10:48,798 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK] 2023-07-14 18:10:48,802 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK] 2023-07-14 18:10:48,802 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK] 2023-07-14 18:10:48,830 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK] 2023-07-14 18:10:48,831 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK] 2023-07-14 18:10:48,876 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK] 2023-07-14 18:10:48,876 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK] 2023-07-14 18:10:48,876 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK] 2023-07-14 18:10:48,880 INFO [RS:0;jenkins-hbase20:38741] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,38741,1689358246539/jenkins-hbase20.apache.org%2C38741%2C1689358246539.1689358248763 2023-07-14 18:10:48,897 DEBUG [RS:0;jenkins-hbase20:38741] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK], DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK], DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK]] 2023-07-14 18:10:48,899 INFO [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34151,1689358246638/jenkins-hbase20.apache.org%2C34151%2C1689358246638.1689358248763 2023-07-14 18:10:48,900 DEBUG [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK], DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK], DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK]] 2023-07-14 18:10:48,905 INFO [RS:1;jenkins-hbase20:34403] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34403,1689358246599/jenkins-hbase20.apache.org%2C34403%2C1689358246599.1689358248779 2023-07-14 18:10:48,905 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:48,907 DEBUG [RS:1;jenkins-hbase20:34403] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK], DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK], DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK]] 2023-07-14 18:10:48,910 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:10:48,916 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:10:48,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 18:10:48,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 18:10:48,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34151%2C1689358246638.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34151,1689358246638, archiveDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs, maxLogs=32 2023-07-14 18:10:48,994 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK] 2023-07-14 18:10:48,995 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK] 2023-07-14 18:10:49,001 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK] 2023-07-14 18:10:49,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/WALs/jenkins-hbase20.apache.org,34151,1689358246638/jenkins-hbase20.apache.org%2C34151%2C1689358246638.meta.1689358248966.meta 2023-07-14 18:10:49,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42179,DS-de3d1c81-2420-40e5-bb3a-f804ca8d5cad,DISK], DatanodeInfoWithStorage[127.0.0.1:42633,DS-b982b749-d4a4-4112-b0fc-b8a0fe8e2722,DISK], DatanodeInfoWithStorage[127.0.0.1:33225,DS-4fa16d51-6cee-4617-a5b3-8600402caabf,DISK]] 2023-07-14 18:10:49,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 18:10:49,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 18:10:49,031 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:49,032 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 18:10:49,035 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 18:10:49,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 18:10:49,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 18:10:49,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:49,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 18:10:49,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 18:10:49,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 18:10:49,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/info 2023-07-14 18:10:49,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/info 2023-07-14 18:10:49,063 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 18:10:49,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:49,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 18:10:49,066 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/rep_barrier 2023-07-14 18:10:49,066 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/rep_barrier 2023-07-14 18:10:49,066 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 18:10:49,067 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:49,067 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 18:10:49,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/table 2023-07-14 18:10:49,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/table 2023-07-14 18:10:49,069 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 18:10:49,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:49,072 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740 2023-07-14 18:10:49,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740 2023-07-14 18:10:49,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 18:10:49,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 18:10:49,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62477232, jitterRate=-0.06901669502258301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 18:10:49,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 18:10:49,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689358248889 2023-07-14 18:10:49,149 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34151,1689358246638, state=OPEN 2023-07-14 18:10:49,166 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 18:10:49,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 18:10:49,166 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 18:10:49,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 18:10:49,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 18:10:49,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34151,1689358246638 in 479 msec 2023-07-14 18:10:49,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 18:10:49,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 716 msec 2023-07-14 18:10:49,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0860 sec 2023-07-14 18:10:49,196 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689358249196, completionTime=-1 2023-07-14 18:10:49,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 18:10:49,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 18:10:49,275 DEBUG [hconnection-0x2f3addaa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:49,280 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:49,304 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 18:10:49,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689358309304 2023-07-14 18:10:49,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689358369305 2023-07-14 18:10:49,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 107 msec 2023-07-14 18:10:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44973,1689358245251-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44973,1689358245251-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:49,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44973,1689358245251-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:49,336 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44973, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:49,337 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 18:10:49,353 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 18:10:49,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 18:10:49,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 18:10:49,374 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 18:10:49,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:10:49,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:10:49,416 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,419 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92 empty. 2023-07-14 18:10:49,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,420 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 18:10:49,463 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 18:10:49,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7f8a6003a2c230c6d1cd0121282a5f92, NAME => 'hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:10:49,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:49,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7f8a6003a2c230c6d1cd0121282a5f92, disabling compactions & flushes 2023-07-14 18:10:49,493 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. after waiting 0 ms 2023-07-14 18:10:49,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,493 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7f8a6003a2c230c6d1cd0121282a5f92: 2023-07-14 18:10:49,498 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:10:49,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689358249502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358249502"}]},"ts":"1689358249502"} 2023-07-14 18:10:49,613 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 18:10:49,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:10:49,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358249615"}]},"ts":"1689358249615"} 2023-07-14 18:10:49,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 18:10:49,629 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:10:49,630 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:10:49,631 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:10:49,631 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:10:49,631 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:10:49,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7f8a6003a2c230c6d1cd0121282a5f92, ASSIGN}] 2023-07-14 18:10:49,638 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7f8a6003a2c230c6d1cd0121282a5f92, ASSIGN 2023-07-14 18:10:49,640 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7f8a6003a2c230c6d1cd0121282a5f92, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:10:49,795 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 18:10:49,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7f8a6003a2c230c6d1cd0121282a5f92, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:49,796 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689358249795"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358249795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358249795"}]},"ts":"1689358249795"} 2023-07-14 18:10:49,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7f8a6003a2c230c6d1cd0121282a5f92, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:10:49,956 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:49,956 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:10:49,959 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:10:49,966 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,966 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f8a6003a2c230c6d1cd0121282a5f92, NAME => 'hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.', STARTKEY => '', ENDKEY => ''} 2023-07-14 18:10:49,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. service=AccessControlService 2023-07-14 18:10:49,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:49,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:49,969 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,969 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,972 INFO [StoreOpener-7f8a6003a2c230c6d1cd0121282a5f92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,974 DEBUG [StoreOpener-7f8a6003a2c230c6d1cd0121282a5f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/info 2023-07-14 18:10:49,974 DEBUG [StoreOpener-7f8a6003a2c230c6d1cd0121282a5f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/info 2023-07-14 18:10:49,975 INFO [StoreOpener-7f8a6003a2c230c6d1cd0121282a5f92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f8a6003a2c230c6d1cd0121282a5f92 columnFamilyName info 2023-07-14 18:10:49,976 INFO [StoreOpener-7f8a6003a2c230c6d1cd0121282a5f92-1] regionserver.HStore(310): Store=7f8a6003a2c230c6d1cd0121282a5f92/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:49,978 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:10:49,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:49,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7f8a6003a2c230c6d1cd0121282a5f92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58881510, jitterRate=-0.12259712815284729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:10:49,989 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7f8a6003a2c230c6d1cd0121282a5f92: 2023-07-14 18:10:49,993 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92., pid=6, masterSystemTime=1689358249955 2023-07-14 18:10:49,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,998 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:10:49,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7f8a6003a2c230c6d1cd0121282a5f92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:50,000 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689358249999"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358249999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358249999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358249999"}]},"ts":"1689358249999"} 2023-07-14 18:10:50,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 18:10:50,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7f8a6003a2c230c6d1cd0121282a5f92, server=jenkins-hbase20.apache.org,34403,1689358246599 in 203 msec 2023-07-14 18:10:50,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 18:10:50,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7f8a6003a2c230c6d1cd0121282a5f92, ASSIGN in 373 msec 2023-07-14 18:10:50,014 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:10:50,015 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358250015"}]},"ts":"1689358250015"} 2023-07-14 18:10:50,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 18:10:50,021 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:10:50,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 660 msec 2023-07-14 18:10:50,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 18:10:50,079 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 18:10:50,079 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:50,102 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:50,106 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:50,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 18:10:50,137 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 18:10:50,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-14 18:10:50,154 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 18:10:50,167 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 18:10:50,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-14 18:10:50,183 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 18:10:50,185 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 18:10:50,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.476sec 2023-07-14 18:10:50,188 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 18:10:50,190 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 18:10:50,190 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 18:10:50,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44973,1689358245251-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 18:10:50,192 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44973,1689358245251-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 18:10:50,212 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 18:10:50,214 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 18:10:50,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:10:50,218 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:10:50,221 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 18:10:50,222 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0 empty. 2023-07-14 18:10:50,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 18:10:50,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 18:10:50,254 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 18:10:50,255 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 77a92e75cc79d4f3b63a26b004e309a0, NAME => 'hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 77a92e75cc79d4f3b63a26b004e309a0, disabling compactions & flushes 2023-07-14 18:10:50,283 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. after waiting 0 ms 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,283 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,283 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 77a92e75cc79d4f3b63a26b004e309a0: 2023-07-14 18:10:50,288 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:10:50,290 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689358250289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358250289"}]},"ts":"1689358250289"} 2023-07-14 18:10:50,291 DEBUG [Listener at localhost.localdomain/41397] zookeeper.ReadOnlyZKClient(139): Connect 0x6cf79b50 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:50,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 18:10:50,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:10:50,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358250296"}]},"ts":"1689358250296"} 2023-07-14 18:10:50,297 DEBUG [Listener at localhost.localdomain/41397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e178a9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:50,298 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 18:10:50,303 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:10:50,305 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:10:50,305 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:10:50,305 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:10:50,306 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:10:50,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=77a92e75cc79d4f3b63a26b004e309a0, ASSIGN}] 2023-07-14 18:10:50,308 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=77a92e75cc79d4f3b63a26b004e309a0, ASSIGN 2023-07-14 18:10:50,309 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=77a92e75cc79d4f3b63a26b004e309a0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:10:50,314 DEBUG [hconnection-0x3383883c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:50,326 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:50,328 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:10:50,328 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 18:10:50,328 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/test.cache.data in system properties and HBase conf 2023-07-14 18:10:50,328 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop.log.dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 18:10:50,329 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 18:10:50,330 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/nfs.dump.dir in system properties and HBase conf 2023-07-14 18:10:50,330 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir in system properties and HBase conf 2023-07-14 18:10:50,330 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 18:10:50,330 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 18:10:50,330 INFO [Listener at localhost.localdomain/41397] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 18:10:50,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 18:10:50,460 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 18:10:50,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=77a92e75cc79d4f3b63a26b004e309a0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:50,461 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689358250461"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358250461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358250461"}]},"ts":"1689358250461"} 2023-07-14 18:10:50,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 77a92e75cc79d4f3b63a26b004e309a0, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:10:50,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 18:10:50,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77a92e75cc79d4f3b63a26b004e309a0, NAME => 'hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.', STARTKEY => '', ENDKEY => ''} 2023-07-14 18:10:50,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. service=AccessControlService 2023-07-14 18:10:50,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:50,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:50,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,633 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,637 INFO [StoreOpener-77a92e75cc79d4f3b63a26b004e309a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,639 DEBUG [StoreOpener-77a92e75cc79d4f3b63a26b004e309a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/l 2023-07-14 18:10:50,640 DEBUG [StoreOpener-77a92e75cc79d4f3b63a26b004e309a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/l 2023-07-14 18:10:50,640 INFO [StoreOpener-77a92e75cc79d4f3b63a26b004e309a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77a92e75cc79d4f3b63a26b004e309a0 columnFamilyName l 2023-07-14 18:10:50,643 INFO [StoreOpener-77a92e75cc79d4f3b63a26b004e309a0-1] regionserver.HStore(310): Store=77a92e75cc79d4f3b63a26b004e309a0/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:50,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:10:50,674 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:50,676 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 77a92e75cc79d4f3b63a26b004e309a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69946380, jitterRate=0.042282283306121826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:10:50,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 77a92e75cc79d4f3b63a26b004e309a0: 2023-07-14 18:10:50,678 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0., pid=11, masterSystemTime=1689358250621 2023-07-14 18:10:50,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:10:50,683 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=77a92e75cc79d4f3b63a26b004e309a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:50,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689358250683"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358250683"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358250683"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358250683"}]},"ts":"1689358250683"} 2023-07-14 18:10:50,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 18:10:50,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 77a92e75cc79d4f3b63a26b004e309a0, server=jenkins-hbase20.apache.org,34403,1689358246599 in 222 msec 2023-07-14 18:10:50,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 18:10:50,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=77a92e75cc79d4f3b63a26b004e309a0, ASSIGN in 392 msec 2023-07-14 18:10:50,724 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:10:50,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358250725"}]},"ts":"1689358250725"} 2023-07-14 18:10:50,728 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 18:10:50,731 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:10:50,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 519 msec 2023-07-14 18:10:50,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 18:10:50,836 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 18:10:50,869 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 18:10:51,687 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:52,026 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:52,032 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34905_jobhistory____6nfb3u/webapp 2023-07-14 18:10:52,175 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 18:10:52,175 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 18:10:52,175 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 18:10:52,177 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 18:10:52,245 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:52,565 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:52,966 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 18:10:53,017 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34905 2023-07-14 18:10:54,612 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:10:54,770 WARN [Listener at jenkins-hbase20.apache.org/40345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:54,879 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 18:10:54,880 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 18:10:54,881 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 18:10:54,908 WARN [Listener at jenkins-hbase20.apache.org/40345] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 18:10:54,909 INFO [Listener at jenkins-hbase20.apache.org/40345] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:54,918 INFO [Listener at jenkins-hbase20.apache.org/40345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_45441_cluster____.q7q9z4/webapp 2023-07-14 18:10:54,988 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 18:10:54,988 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 18:10:54,989 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 18:10:54,989 INFO [Listener at jenkins-hbase20.apache.org/40345] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 18:10:55,001 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:55,183 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:55,306 INFO [Listener at jenkins-hbase20.apache.org/40345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:55,316 INFO [Listener at jenkins-hbase20.apache.org/40345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:45441 2023-07-14 18:10:55,425 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:10:55,425 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 18:10:55,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:10:55,426 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 18:10:55,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 18:10:55,426 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 18:10:55,426 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:10:55,426 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 18:10:55,427 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 18:10:55,427 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 18:10:55,718 WARN [Listener at jenkins-hbase20.apache.org/41025] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:55,748 WARN [Listener at jenkins-hbase20.apache.org/41025] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 18:10:55,749 INFO [Listener at jenkins-hbase20.apache.org/41025] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:55,757 INFO [Listener at jenkins-hbase20.apache.org/41025] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44749_node____bajzgu/webapp 2023-07-14 18:10:55,845 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 18:10:55,846 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 18:10:55,846 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 18:10:55,846 INFO [Listener at jenkins-hbase20.apache.org/41025] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 18:10:55,859 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:55,892 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:56,022 INFO [Listener at jenkins-hbase20.apache.org/41025] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:56,079 INFO [Listener at jenkins-hbase20.apache.org/41025] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44749 2023-07-14 18:10:56,425 WARN [Listener at jenkins-hbase20.apache.org/37587] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 18:10:56,435 WARN [Listener at jenkins-hbase20.apache.org/37587] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 18:10:56,435 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 18:10:56,451 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44419_node____.vv3ihe/webapp 2023-07-14 18:10:56,517 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 18:10:56,517 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 18:10:56,517 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 18:10:56,517 INFO [Listener at jenkins-hbase20.apache.org/37587] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 18:10:56,531 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:56,550 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:56,626 INFO [Listener at jenkins-hbase20.apache.org/37587] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 18:10:56,636 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44419 2023-07-14 18:10:56,668 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 18:10:56,670 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:10:56,749 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=4672 2023-07-14 18:10:56,750 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-14 18:10:56,763 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 18:10:56,769 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 18:10:56,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:10:56,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:10:56,781 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:10:56,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 18:10:56,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 18:10:56,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:10:56,789 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:56,790 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:56,790 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e empty. 2023-07-14 18:10:56,791 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 empty. 2023-07-14 18:10:56,793 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:56,796 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:56,796 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 18:10:56,828 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 18:10:56,830 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d0280eb12b56f31361838de95c1685e, NAME => 'testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:10:56,831 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 37afcf7ddbb0c4f97ba2b33a143fbfc2, NAME => 'testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:10:56,873 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:56,874 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9d0280eb12b56f31361838de95c1685e, disabling compactions & flushes 2023-07-14 18:10:56,874 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:56,874 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:56,874 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. after waiting 0 ms 2023-07-14 18:10:56,874 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:56,874 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:56,877 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 37afcf7ddbb0c4f97ba2b33a143fbfc2, disabling compactions & flushes 2023-07-14 18:10:56,877 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:56,878 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:56,878 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9d0280eb12b56f31361838de95c1685e: 2023-07-14 18:10:56,878 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:56,878 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. after waiting 0 ms 2023-07-14 18:10:56,878 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:56,878 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:56,878 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 37afcf7ddbb0c4f97ba2b33a143fbfc2: 2023-07-14 18:10:56,882 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:10:56,883 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358256883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358256883"}]},"ts":"1689358256883"} 2023-07-14 18:10:56,884 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358256883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358256883"}]},"ts":"1689358256883"} 2023-07-14 18:10:56,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 18:10:56,925 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:10:56,927 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:10:56,927 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358256927"}]},"ts":"1689358256927"} 2023-07-14 18:10:56,929 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 18:10:56,932 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:10:56,934 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:10:56,934 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:10:56,934 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:10:56,934 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:10:56,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, ASSIGN}] 2023-07-14 18:10:56,938 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, ASSIGN 2023-07-14 18:10:56,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, ASSIGN 2023-07-14 18:10:56,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:10:56,939 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38741,1689358246539; forceNewPlan=false, retain=false 2023-07-14 18:10:57,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 18:10:57,089 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:10:57,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d0280eb12b56f31361838de95c1685e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,091 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37afcf7ddbb0c4f97ba2b33a143fbfc2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358257091"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358257091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358257091"}]},"ts":"1689358257091"} 2023-07-14 18:10:57,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358257091"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358257091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358257091"}]},"ts":"1689358257091"} 2023-07-14 18:10:57,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 9d0280eb12b56f31361838de95c1685e, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:10:57,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 37afcf7ddbb0c4f97ba2b33a143fbfc2, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:10:57,250 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,250 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:10:57,254 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:10:57,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d0280eb12b56f31361838de95c1685e, NAME => 'testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:10:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. service=AccessControlService 2023-07-14 18:10:57,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:57,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:57,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:57,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37afcf7ddbb0c4f97ba2b33a143fbfc2, NAME => 'testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:10:57,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. service=AccessControlService 2023-07-14 18:10:57,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:10:57,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:10:57,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,263 INFO [StoreOpener-9d0280eb12b56f31361838de95c1685e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,263 INFO [StoreOpener-37afcf7ddbb0c4f97ba2b33a143fbfc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,268 DEBUG [StoreOpener-9d0280eb12b56f31361838de95c1685e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf 2023-07-14 18:10:57,268 DEBUG [StoreOpener-9d0280eb12b56f31361838de95c1685e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf 2023-07-14 18:10:57,268 DEBUG [StoreOpener-37afcf7ddbb0c4f97ba2b33a143fbfc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf 2023-07-14 18:10:57,268 DEBUG [StoreOpener-37afcf7ddbb0c4f97ba2b33a143fbfc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf 2023-07-14 18:10:57,272 INFO [StoreOpener-9d0280eb12b56f31361838de95c1685e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d0280eb12b56f31361838de95c1685e columnFamilyName cf 2023-07-14 18:10:57,272 INFO [StoreOpener-37afcf7ddbb0c4f97ba2b33a143fbfc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37afcf7ddbb0c4f97ba2b33a143fbfc2 columnFamilyName cf 2023-07-14 18:10:57,275 INFO [StoreOpener-37afcf7ddbb0c4f97ba2b33a143fbfc2-1] regionserver.HStore(310): Store=37afcf7ddbb0c4f97ba2b33a143fbfc2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:57,275 INFO [StoreOpener-9d0280eb12b56f31361838de95c1685e-1] regionserver.HStore(310): Store=9d0280eb12b56f31361838de95c1685e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:10:57,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:10:57,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:10:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:57,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 37afcf7ddbb0c4f97ba2b33a143fbfc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74385292, jitterRate=0.10842722654342651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:10:57,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:10:57,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 37afcf7ddbb0c4f97ba2b33a143fbfc2: 2023-07-14 18:10:57,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9d0280eb12b56f31361838de95c1685e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64049512, jitterRate=-0.045587897300720215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:10:57,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9d0280eb12b56f31361838de95c1685e: 2023-07-14 18:10:57,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2., pid=16, masterSystemTime=1689358257250 2023-07-14 18:10:57,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e., pid=15, masterSystemTime=1689358257247 2023-07-14 18:10:57,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:57,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:57,303 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37afcf7ddbb0c4f97ba2b33a143fbfc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,303 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358257302"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358257302"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358257302"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358257302"}]},"ts":"1689358257302"} 2023-07-14 18:10:57,304 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9d0280eb12b56f31361838de95c1685e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,304 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358257304"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358257304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358257304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358257304"}]},"ts":"1689358257304"} 2023-07-14 18:10:57,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 18:10:57,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 37afcf7ddbb0c4f97ba2b33a143fbfc2, server=jenkins-hbase20.apache.org,38741,1689358246539 in 210 msec 2023-07-14 18:10:57,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 18:10:57,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 9d0280eb12b56f31361838de95c1685e, server=jenkins-hbase20.apache.org,34403,1689358246599 in 212 msec 2023-07-14 18:10:57,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, ASSIGN in 375 msec 2023-07-14 18:10:57,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 18:10:57,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, ASSIGN in 378 msec 2023-07-14 18:10:57,317 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:10:57,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358257317"}]},"ts":"1689358257317"} 2023-07-14 18:10:57,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 18:10:57,321 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:10:57,327 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 18:10:57,336 DEBUG [hconnection-0x383f1794-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,340 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,348 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 18:10:57,374 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 18:10:57,374 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 18:10:57,374 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 18:10:57,374 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 18:10:57,375 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:10:57,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 18:10:57,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 18:10:57,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 18:10:57,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 18:10:57,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 605 msec 2023-07-14 18:10:57,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 18:10:57,390 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 18:10:57,395 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 18:10:57,396 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,399 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:10:57,435 DEBUG [hconnection-0x3383883c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,439 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,443 DEBUG [hconnection-0x3383883c-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,451 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358257466 (current time:1689358257466). 2023-07-14 18:10:57,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:10:57,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x669f0ff5 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:57,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@155631b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:57,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,476 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x669f0ff5 to 127.0.0.1:57638 2023-07-14 18:10:57,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:10:57,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x2bbed8d6 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:57,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a33f0d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:57,497 DEBUG [hconnection-0x76f24827-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,501 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,509 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bbed8d6 to 127.0.0.1:57638 2023-07-14 18:10:57,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:10:57,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 18:10:57,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:10:57,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:57,566 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:57,567 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689358857567 2023-07-14 18:10:57,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 18:10:57,571 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:57,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:57,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-14 18:10:57,575 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:57,576 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689358857576 2023-07-14 18:10:57,576 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:10:57,576 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:10:57,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,606 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 18:10:57,606 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:57,607 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 18:10:57,607 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 18:10:57,608 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,608 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,614 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,619 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,619 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 18:10:57,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,623 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 18:10:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:57,624 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 18:10:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:57,626 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,626 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,626 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,627 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:10:57,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,627 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:57,627 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:57,629 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:57,630 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:57,630 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:57,630 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:57,633 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,633 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:57,634 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,634 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:57,634 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,634 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e696881[Count = 1] remaining members to acquire global barrier 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:57,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 18:10:57,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e696881[Count = 0] remaining members to acquire global barrier 2023-07-14 18:10:57,638 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 18:10:57,638 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,640 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:57,640 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,640 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:57,640 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:57,641 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:10:57,641 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,641 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:10:57,643 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:10:57,643 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:10:57,643 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,643 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:57,643 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. started... 2023-07-14 18:10:57,643 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. started... 2023-07-14 18:10:57,646 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d0280eb12b56f31361838de95c1685e: 2023-07-14 18:10:57,646 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37afcf7ddbb0c4f97ba2b33a143fbfc2: 2023-07-14 18:10:57,647 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,647 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,653 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:10:57,653 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:10:57,658 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:10:57,658 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:10:57,676 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:10:57,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 18:10:57,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:10:57,686 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. completed. 2023-07-14 18:10:57,686 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,689 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:10:57,689 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:10:57,689 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:10:57,689 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,690 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:57,690 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:10:57,691 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,691 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:57,692 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:57,694 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. completed. 2023-07-14 18:10:57,694 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:10:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:10:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:57,694 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:10:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,695 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,695 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,695 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:57,695 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:10:57,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 18:10:57,702 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 18:10:57,702 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:10:57,702 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:10:57,702 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,702 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:57,707 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:57,709 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,710 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:57,711 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:57,713 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,714 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,714 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,730 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:57,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:57,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,731 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,731 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 18:10:57,731 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:57,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:57,731 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:57,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,731 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:57,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:10:57,732 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:57,732 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,732 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:10:57,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 18:10:57,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,846 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 18:10:57,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689358257568Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689358257757 (+189 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689358257757Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689358257758 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689358257769 (+11 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689358257794 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689358257845 (+51 ms) 2023-07-14 18:10:57,849 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:57,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 280 msec 2023-07-14 18:10:57,889 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:10:57,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 18:10:57,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:10:57,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:10:57,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38741] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:10:57,924 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 18:10:57,924 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:57,924 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:10:57,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358257948 (current time:1689358257948). 2023-07-14 18:10:57,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:10:57,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x2f40f859 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:57,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3736759b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:57,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,962 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f40f859 to 127.0.0.1:57638 2023-07-14 18:10:57,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:10:57,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6bcc8000 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:10:57,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43e63f10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:10:57,974 DEBUG [hconnection-0x4778105a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,979 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:10:57,986 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:10:57,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bcc8000 to 127.0.0.1:57638 2023-07-14 18:10:57,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:10:57,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 18:10:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:10:57,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:57,995 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:57,997 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689358857997 2023-07-14 18:10:57,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 18:10:57,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 18:10:57,999 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:10:57,999 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:10:58,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:58,001 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 18:10:58,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-14 18:10:58,006 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:58,007 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689358858007 2023-07-14 18:10:58,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 18:10:58,024 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 18:10:58,024 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:58,025 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 18:10:58,025 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 18:10:58,026 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,026 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,027 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,027 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,027 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,027 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,028 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,028 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,028 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,028 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:58,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 18:10:58,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 18:10:58,030 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:58,030 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:58,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 18:10:58,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:10:58,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:58,032 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:58,035 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 18:10:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,040 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,040 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,041 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:58,041 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:10:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d022bc[Count = 1] remaining members to acquire global barrier 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:58,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 18:10:58,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d022bc[Count = 0] remaining members to acquire global barrier 2023-07-14 18:10:58,046 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 18:10:58,046 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,049 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:58,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:58,050 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,050 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:58,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:10:58,051 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. started... 2023-07-14 18:10:58,050 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 18:10:58,051 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:58,051 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,050 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:10:58,051 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:10:58,051 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. started... 2023-07-14 18:10:58,051 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:58,051 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:10:58,051 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:10:58,051 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d0280eb12b56f31361838de95c1685e 1/1 column families, dataSize=735 B heapSize=1.80 KB 2023-07-14 18:10:58,051 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37afcf7ddbb0c4f97ba2b33a143fbfc2 1/1 column families, dataSize=2.54 KB heapSize=5.73 KB 2023-07-14 18:10:58,051 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:10:58,058 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:58,058 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:58,058 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:58,099 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:10:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 18:10:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:10:58,102 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:10:58,204 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818 2023-07-14 18:10:58,204 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265 2023-07-14 18:10:58,237 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=735, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/.tmp/cf/485ff5bc6b2f452c84fd5d3fac367af9 2023-07-14 18:10:58,251 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.5 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/.tmp/cf/3a03977b88454485aea8d55e62cf9524 2023-07-14 18:10:58,257 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/.tmp/cf/485ff5bc6b2f452c84fd5d3fac367af9 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9 2023-07-14 18:10:58,262 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/.tmp/cf/3a03977b88454485aea8d55e62cf9524 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524 2023-07-14 18:10:58,267 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9, entries=11, sequenceid=6, filesize=6.7 K 2023-07-14 18:10:58,271 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~735 B/735, heapSize ~1.78 KB/1824, currentSize=0 B/0 for 9d0280eb12b56f31361838de95c1685e in 220ms, sequenceid=6, compaction requested=false 2023-07-14 18:10:58,271 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 18:10:58,272 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d0280eb12b56f31361838de95c1685e: 2023-07-14 18:10:58,273 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 18:10:58,273 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:10:58,273 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9] hfiles 2023-07-14 18:10:58,273 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 18:10:58,274 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524, entries=39, sequenceid=6, filesize=11.5 K 2023-07-14 18:10:58,278 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.54 KB/2601, heapSize ~5.72 KB/5856, currentSize=0 B/0 for 37afcf7ddbb0c4f97ba2b33a143fbfc2 in 227ms, sequenceid=6, compaction requested=false 2023-07-14 18:10:58,280 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37afcf7ddbb0c4f97ba2b33a143fbfc2: 2023-07-14 18:10:58,280 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 18:10:58,280 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:10:58,280 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524] hfiles 2023-07-14 18:10:58,280 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 18:10:58,302 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:10:58,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 18:10:58,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:10:58,306 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 18:10:58,309 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. completed. 2023-07-14 18:10:58,309 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:10:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:10:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:10:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:58,309 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:10:58,311 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,311 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:58,311 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:58,312 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:58,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:58,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:58,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,322 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. completed. 2023-07-14 18:10:58,322 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:10:58,322 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:10:58,323 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:10:58,323 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,323 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 18:10:58,323 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:10:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:10:58,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 18:10:58,324 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,324 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 18:10:58,324 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:58,324 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 18:10:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:10:58,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 18:10:58,331 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 18:10:58,331 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:10:58,331 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:10:58,331 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 18:10:58,331 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:10:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,339 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,338 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,339 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,340 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:10:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,342 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:10:58,342 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 18:10:58,343 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,353 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,353 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,353 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,353 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,354 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,353 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:10:58,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,354 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,354 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 18:10:58,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,354 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:10:58,354 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:10:58,354 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:10:58,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:10:58,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 18:10:58,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:10:58,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 18:10:58,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:10:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:10:58,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:10:58,356 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:10:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:10:58,356 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,356 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818] mob files 2023-07-14 18:10:58,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265 2023-07-14 18:10:58,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818 2023-07-14 18:10:58,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 18:10:58,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 18:10:58,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 18:10:58,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689358257997Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689358258372 (+375 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689358258372Loading Region manifests for snaptb0-testExportWithTargetName at 1689358258372Writing data manifest for snaptb0-testExportWithTargetName at 1689358258378 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689358258397 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689358258479 (+82 ms) 2023-07-14 18:10:58,483 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 18:10:58,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 486 msec 2023-07-14 18:10:58,607 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:10:58,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 18:10:58,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:10:58,610 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610 2023-07-14 18:10:58,610 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46427, tgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610, rawTgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:58,646 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:10:58,646 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1667182518_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 18:10:58,646 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 18:10:58,666 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 18:10:58,736 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,737 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,737 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,737 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,737 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,738 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,738 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,805 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-8036222544909728092.jar 2023-07-14 18:10:58,805 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,806 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,807 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,807 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,808 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,808 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:10:58,809 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:10:58,810 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:10:58,810 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:10:58,811 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:10:58,811 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:10:58,812 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:10:58,813 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:10:58,813 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:10:58,814 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:10:58,815 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:10:58,819 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:10:58,820 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:10:58,820 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:10:58,821 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:10:58,821 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:10:58,822 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:10:58,822 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:00,192 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:11:00,198 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 18:11:00,206 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 18:11:00,719 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:00,720 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:01,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0001_000001 (auth:SIMPLE) 2023-07-14 18:11:02,776 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:11:06,024 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0001_000001 (auth:SIMPLE) 2023-07-14 18:11:08,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0001_000001 (auth:SIMPLE) 2023-07-14 18:11:10,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0001_000001 (auth:SIMPLE) 2023-07-14 18:11:12,135 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:11:12,138 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:11:12,150 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 18:11:12,150 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:11:12,151 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:11:12,151 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 18:11:12,151 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 18:11:12,151 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 18:11:12,151 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/testExportWithTargetName 2023-07-14 18:11:12,152 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 18:11:12,152 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358258610/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 18:11:12,162 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 18:11:12,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-07-14 18:11:12,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,179 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358272179"}]},"ts":"1689358272179"} 2023-07-14 18:11:12,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 18:11:12,181 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 18:11:12,182 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 18:11:12,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, UNASSIGN}] 2023-07-14 18:11:12,186 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, UNASSIGN 2023-07-14 18:11:12,187 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, UNASSIGN 2023-07-14 18:11:12,188 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d0280eb12b56f31361838de95c1685e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:12,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=37afcf7ddbb0c4f97ba2b33a143fbfc2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:12,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358272188"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358272188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358272188"}]},"ts":"1689358272188"} 2023-07-14 18:11:12,188 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358272188"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358272188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358272188"}]},"ts":"1689358272188"} 2023-07-14 18:11:12,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 37afcf7ddbb0c4f97ba2b33a143fbfc2, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:11:12,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 9d0280eb12b56f31361838de95c1685e, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:11:12,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 18:11:12,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:11:12,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 37afcf7ddbb0c4f97ba2b33a143fbfc2, disabling compactions & flushes 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9d0280eb12b56f31361838de95c1685e, disabling compactions & flushes 2023-07-14 18:11:12,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. after waiting 0 ms 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:11:12,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. after waiting 0 ms 2023-07-14 18:11:12,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:11:12,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:12,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:12,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:12,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:12,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e. 2023-07-14 18:11:12,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2. 2023-07-14 18:11:12,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9d0280eb12b56f31361838de95c1685e: 2023-07-14 18:11:12,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 37afcf7ddbb0c4f97ba2b33a143fbfc2: 2023-07-14 18:11:12,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:11:12,371 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=37afcf7ddbb0c4f97ba2b33a143fbfc2, regionState=CLOSED 2023-07-14 18:11:12,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9d0280eb12b56f31361838de95c1685e 2023-07-14 18:11:12,371 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358272371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358272371"}]},"ts":"1689358272371"} 2023-07-14 18:11:12,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9d0280eb12b56f31361838de95c1685e, regionState=CLOSED 2023-07-14 18:11:12,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689358272372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358272372"}]},"ts":"1689358272372"} 2023-07-14 18:11:12,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-14 18:11:12,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-14 18:11:12,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 9d0280eb12b56f31361838de95c1685e, server=jenkins-hbase20.apache.org,34403,1689358246599 in 184 msec 2023-07-14 18:11:12,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 37afcf7ddbb0c4f97ba2b33a143fbfc2, server=jenkins-hbase20.apache.org,38741,1689358246539 in 183 msec 2023-07-14 18:11:12,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37afcf7ddbb0c4f97ba2b33a143fbfc2, UNASSIGN in 195 msec 2023-07-14 18:11:12,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-14 18:11:12,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9d0280eb12b56f31361838de95c1685e, UNASSIGN in 195 msec 2023-07-14 18:11:12,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358272382"}]},"ts":"1689358272382"} 2023-07-14 18:11:12,384 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 18:11:12,385 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 18:11:12,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-07-14 18:11:12,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 18:11:12,483 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 18:11:12,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-07-14 18:11:12,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,495 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 18:11:12,497 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,501 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 18:11:12,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 18:11:12,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 18:11:12,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 18:11:12,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 18:11:12,503 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:11:12,503 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:11:12,504 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:12,504 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:12,504 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:12,504 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:12,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 18:11:12,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 18:11:12,504 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 18:11:12,504 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 18:11:12,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 18:11:12,506 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 18:11:12,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 18:11:12,507 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 18:11:12,507 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/recovered.edits] 2023-07-14 18:11:12,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/recovered.edits] 2023-07-14 18:11:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 18:11:12,513 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/cf/3a03977b88454485aea8d55e62cf9524 2023-07-14 18:11:12,513 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/cf/485ff5bc6b2f452c84fd5d3fac367af9 2023-07-14 18:11:12,517 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2/recovered.edits/9.seqid 2023-07-14 18:11:12,518 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e/recovered.edits/9.seqid 2023-07-14 18:11:12,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/37afcf7ddbb0c4f97ba2b33a143fbfc2 2023-07-14 18:11:12,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportWithTargetName/9d0280eb12b56f31361838de95c1685e 2023-07-14 18:11:12,520 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 18:11:12,521 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 18:11:12,522 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-14 18:11:12,526 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071401814fb9bbc643268b1ae9afdeb9c265 2023-07-14 18:11:12,528 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307142c4478e237874b58a69c661f88478818 2023-07-14 18:11:12,528 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 18:11:12,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,553 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 18:11:12,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 18:11:12,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 18:11:12,559 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358272558"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:12,559 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358272558"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:12,562 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:11:12,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9d0280eb12b56f31361838de95c1685e, NAME => 'testtb-testExportWithTargetName,,1689358256775.9d0280eb12b56f31361838de95c1685e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 37afcf7ddbb0c4f97ba2b33a143fbfc2, NAME => 'testtb-testExportWithTargetName,1,1689358256775.37afcf7ddbb0c4f97ba2b33a143fbfc2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:11:12,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 18:11:12,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358272562"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:12,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 18:11:12,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 18:11:12,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-07-14 18:11:12,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 18:11:12,611 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 18:11:12,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 18:11:12,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 18:11:12,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 18:11:12,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 18:11:12,664 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 705) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1980705939_1 at /127.0.0.1:48090 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:43541 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:41025 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1980705939_1 at /127.0.0.1:34642 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:43739 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:34674 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:48108 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:48366 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=3582 (was 4672) 2023-07-14 18:11:12,665 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-14 18:11:12,685 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=173, AvailableMemoryMB=3581 2023-07-14 18:11:12,686 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-14 18:11:12,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:11:12,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:12,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:11:12,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 18:11:12,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 18:11:12,698 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:11:12,701 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:12,701 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:12,701 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 empty. 2023-07-14 18:11:12,701 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb empty. 2023-07-14 18:11:12,702 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:12,702 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:12,702 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 18:11:12,714 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 18:11:12,715 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 115eb2c73a30e25f1f41b5ca290031bb, NAME => 'testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:11:12,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e9903dfe3c0f9846c058ac9821cc6517, NAME => 'testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 115eb2c73a30e25f1f41b5ca290031bb, disabling compactions & flushes 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e9903dfe3c0f9846c058ac9821cc6517, disabling compactions & flushes 2023-07-14 18:11:12,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:12,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. after waiting 0 ms 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. after waiting 0 ms 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:12,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:12,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 115eb2c73a30e25f1f41b5ca290031bb: 2023-07-14 18:11:12,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e9903dfe3c0f9846c058ac9821cc6517: 2023-07-14 18:11:12,746 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:11:12,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358272747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358272747"}]},"ts":"1689358272747"} 2023-07-14 18:11:12,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358272747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358272747"}]},"ts":"1689358272747"} 2023-07-14 18:11:12,750 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:11:12,751 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:11:12,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358272751"}]},"ts":"1689358272751"} 2023-07-14 18:11:12,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 18:11:12,755 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:11:12,757 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:11:12,757 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:11:12,757 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:11:12,757 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:11:12,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, ASSIGN}] 2023-07-14 18:11:12,760 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, ASSIGN 2023-07-14 18:11:12,760 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, ASSIGN 2023-07-14 18:11:12,761 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:11:12,761 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34151,1689358246638; forceNewPlan=false, retain=false 2023-07-14 18:11:12,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 18:11:12,911 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:11:12,916 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e9903dfe3c0f9846c058ac9821cc6517, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:12,916 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=115eb2c73a30e25f1f41b5ca290031bb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:12,916 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358272916"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358272916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358272916"}]},"ts":"1689358272916"} 2023-07-14 18:11:12,916 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358272916"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358272916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358272916"}]},"ts":"1689358272916"} 2023-07-14 18:11:12,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e9903dfe3c0f9846c058ac9821cc6517, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:11:12,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 115eb2c73a30e25f1f41b5ca290031bb, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:11:13,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 18:11:13,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9903dfe3c0f9846c058ac9821cc6517, NAME => 'testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:11:13,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. service=AccessControlService 2023-07-14 18:11:13,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:11:13,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 115eb2c73a30e25f1f41b5ca290031bb, NAME => 'testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:11:13,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:13,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. service=AccessControlService 2023-07-14 18:11:13,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:11:13,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:13,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,100 INFO [StoreOpener-e9903dfe3c0f9846c058ac9821cc6517-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,101 INFO [StoreOpener-115eb2c73a30e25f1f41b5ca290031bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,102 DEBUG [StoreOpener-e9903dfe3c0f9846c058ac9821cc6517-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf 2023-07-14 18:11:13,102 DEBUG [StoreOpener-e9903dfe3c0f9846c058ac9821cc6517-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf 2023-07-14 18:11:13,102 INFO [StoreOpener-e9903dfe3c0f9846c058ac9821cc6517-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9903dfe3c0f9846c058ac9821cc6517 columnFamilyName cf 2023-07-14 18:11:13,102 DEBUG [StoreOpener-115eb2c73a30e25f1f41b5ca290031bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf 2023-07-14 18:11:13,102 DEBUG [StoreOpener-115eb2c73a30e25f1f41b5ca290031bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf 2023-07-14 18:11:13,103 INFO [StoreOpener-115eb2c73a30e25f1f41b5ca290031bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 115eb2c73a30e25f1f41b5ca290031bb columnFamilyName cf 2023-07-14 18:11:13,104 INFO [StoreOpener-e9903dfe3c0f9846c058ac9821cc6517-1] regionserver.HStore(310): Store=e9903dfe3c0f9846c058ac9821cc6517/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:11:13,104 INFO [StoreOpener-115eb2c73a30e25f1f41b5ca290031bb-1] regionserver.HStore(310): Store=115eb2c73a30e25f1f41b5ca290031bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:11:13,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:13,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:11:13,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e9903dfe3c0f9846c058ac9821cc6517; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67318066, jitterRate=0.0031173527240753174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:11:13,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e9903dfe3c0f9846c058ac9821cc6517: 2023-07-14 18:11:13,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517., pid=30, masterSystemTime=1689358273089 2023-07-14 18:11:13,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:11:13,120 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e9903dfe3c0f9846c058ac9821cc6517, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358273120"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358273120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358273120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358273120"}]},"ts":"1689358273120"} 2023-07-14 18:11:13,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 115eb2c73a30e25f1f41b5ca290031bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66329315, jitterRate=-0.011616185307502747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:11:13,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 115eb2c73a30e25f1f41b5ca290031bb: 2023-07-14 18:11:13,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb., pid=31, masterSystemTime=1689358273089 2023-07-14 18:11:13,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-14 18:11:13,132 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=115eb2c73a30e25f1f41b5ca290031bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e9903dfe3c0f9846c058ac9821cc6517, server=jenkins-hbase20.apache.org,34403,1689358246599 in 206 msec 2023-07-14 18:11:13,132 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358273131"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358273131"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358273131"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358273131"}]},"ts":"1689358273131"} 2023-07-14 18:11:13,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, ASSIGN in 375 msec 2023-07-14 18:11:13,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-14 18:11:13,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 115eb2c73a30e25f1f41b5ca290031bb, server=jenkins-hbase20.apache.org,34151,1689358246638 in 210 msec 2023-07-14 18:11:13,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-14 18:11:13,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, ASSIGN in 391 msec 2023-07-14 18:11:13,155 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:11:13,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358273155"}]},"ts":"1689358273155"} 2023-07-14 18:11:13,157 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 18:11:13,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:11:13,160 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 18:11:13,163 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:11:13,173 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:13,173 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:13,173 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:13,173 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:13,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:13,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:13,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:13,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:13,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:13,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:13,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 491 msec 2023-07-14 18:11:13,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 18:11:13,303 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 18:11:13,308 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 18:11:13,308 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,312 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:11:13,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358273349 (current time:1689358273349). 2023-07-14 18:11:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:11:13,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x02b434cf to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:13,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b69ff6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:13,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,371 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02b434cf to 127.0.0.1:57638 2023-07-14 18:11:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:13,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x21eb6aaf to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:13,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25a2011, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:13,391 DEBUG [hconnection-0x763c35b2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,393 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,400 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21eb6aaf to 127.0.0.1:57638 2023-07-14 18:11:13,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:13,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:11:13,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:11:13,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,409 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,411 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689358873410 2023-07-14 18:11:13,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 18:11:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,412 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:11:13,413 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:11:13,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:13,417 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-14 18:11:13,425 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:13,427 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689358873427 2023-07-14 18:11:13,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,441 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 18:11:13,441 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,442 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 18:11:13,442 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 18:11:13,443 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,443 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,444 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,444 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,444 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,445 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,445 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,446 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,446 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 18:11:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,447 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,447 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,449 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,449 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,449 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 18:11:13,449 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,450 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,451 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,451 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,451 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,454 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,454 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,455 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,455 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,455 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,456 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,456 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,459 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,459 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,460 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@255f865b[Count = 1] remaining members to acquire global barrier 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 18:11:13,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@255f865b[Count = 0] remaining members to acquire global barrier 2023-07-14 18:11:13,470 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 18:11:13,470 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,473 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,473 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,473 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,474 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,474 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:13,474 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:11:13,475 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,476 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,476 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:13,476 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,476 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:11:13,476 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:13,476 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:13,478 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:13,482 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,482 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:13,482 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,482 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:13,483 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:13,483 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. started... 2023-07-14 18:11:13,483 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. started... 2023-07-14 18:11:13,484 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 115eb2c73a30e25f1f41b5ca290031bb: 2023-07-14 18:11:13,484 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9903dfe3c0f9846c058ac9821cc6517: 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:11:13,485 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:11:13,497 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. completed. 2023-07-14 18:11:13,497 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,497 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:11:13,498 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. completed. 2023-07-14 18:11:13,498 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:13,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:11:13,513 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:13,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:11:13,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:11:13,514 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:11:13,515 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:13,515 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:13,515 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:13,515 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,517 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,517 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:13,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,517 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:13,517 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:13,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:11:13,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 18:11:13,525 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 18:11:13,525 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:11:13,525 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:11:13,525 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,525 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:11:13,531 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,531 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,531 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,531 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,531 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,533 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,533 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,535 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,535 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,535 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 18:11:13,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,540 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:13,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:11:13,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,540 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,542 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,543 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:11:13,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 18:11:13,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,604 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:13,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689358273411Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689358273551 (+140 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689358273551Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689358273551Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689358273555 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689358273566 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689358273603 (+37 ms) 2023-07-14 18:11:13,607 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:13,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 195 msec 2023-07-14 18:11:13,714 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:13,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:11:13,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:11:13,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34151] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:11:13,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:11:13,728 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 18:11:13,728 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,729 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:11:13,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358273747 (current time:1689358273747). 2023-07-14 18:11:13,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:11:13,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6a94a2b1 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:13,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40232a33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:13,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,760 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a94a2b1 to 127.0.0.1:57638 2023-07-14 18:11:13,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:13,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x5c0d214d to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:13,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ae853be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:13,782 DEBUG [hconnection-0xd332a58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,785 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:13,794 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:13,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c0d214d to 127.0.0.1:57638 2023-07-14 18:11:13,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:13,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:11:13,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:11:13,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,801 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,802 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689358873802 2023-07-14 18:11:13,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 18:11:13,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:11:13,804 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:11:13,804 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:11:13,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:13,806 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:11:13,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 18:11:13,810 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:13,811 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689358873811 2023-07-14 18:11:13,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 18:11:13,828 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 18:11:13,828 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,830 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 18:11:13,831 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 18:11:13,832 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,832 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,835 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,835 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,835 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:13,835 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:13,836 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,836 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,837 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,837 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 18:11:13,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 18:11:13,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,838 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,838 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,843 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,843 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 18:11:13,843 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,843 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 18:11:13,843 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:13,844 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 18:11:13,844 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 18:11:13,844 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 18:11:13,846 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,848 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,848 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,848 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,849 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,849 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74cb858e[Count = 1] remaining members to acquire global barrier 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:13,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 18:11:13,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74cb858e[Count = 0] remaining members to acquire global barrier 2023-07-14 18:11:13,853 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 18:11:13,853 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:13,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,858 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,858 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,858 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:13,859 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:11:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:13,859 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:11:13,859 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:13,859 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:13,859 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:13,859 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:13,859 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:11:13,859 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. started... 2023-07-14 18:11:13,860 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9903dfe3c0f9846c058ac9821cc6517 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-14 18:11:13,860 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:13,860 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:13,860 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:13,861 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. started... 2023-07-14 18:11:13,861 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 115eb2c73a30e25f1f41b5ca290031bb 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-14 18:11:13,865 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:13,865 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:13,865 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:13,906 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:13,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:11:13,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:11:13,908 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:11:13,920 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e 2023-07-14 18:11:13,940 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151 2023-07-14 18:11:13,979 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/.tmp/cf/06f32ce8ab3b4ef08cd8c6610a802d9b 2023-07-14 18:11:13,988 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/.tmp/cf/01914b0d4fae4ef6be6b1f3ef3e3646a 2023-07-14 18:11:14,004 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/.tmp/cf/01914b0d4fae4ef6be6b1f3ef3e3646a as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a 2023-07-14 18:11:14,004 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/.tmp/cf/06f32ce8ab3b4ef08cd8c6610a802d9b as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b 2023-07-14 18:11:14,013 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a, entries=6, sequenceid=6, filesize=5.9 K 2023-07-14 18:11:14,015 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 115eb2c73a30e25f1f41b5ca290031bb in 153ms, sequenceid=6, compaction requested=false 2023-07-14 18:11:14,015 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 18:11:14,016 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 115eb2c73a30e25f1f41b5ca290031bb: 2023-07-14 18:11:14,016 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 18:11:14,016 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:14,016 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a] hfiles 2023-07-14 18:11:14,016 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a for snapshot=snaptb0-testExportFileSystemState 2023-07-14 18:11:14,017 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b, entries=44, sequenceid=6, filesize=12.3 K 2023-07-14 18:11:14,018 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for e9903dfe3c0f9846c058ac9821cc6517 in 159ms, sequenceid=6, compaction requested=false 2023-07-14 18:11:14,021 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9903dfe3c0f9846c058ac9821cc6517: 2023-07-14 18:11:14,021 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 18:11:14,021 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:14,022 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b] hfiles 2023-07-14 18:11:14,022 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b for snapshot=snaptb0-testExportFileSystemState 2023-07-14 18:11:14,038 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. completed. 2023-07-14 18:11:14,038 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:14,038 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:11:14,041 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. completed. 2023-07-14 18:11:14,041 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:14,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:14,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:14,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 18:11:14,041 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:11:14,049 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:14,049 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:14,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 18:11:14,049 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:14,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:14,050 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:14,050 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 18:11:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:11:14,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:11:14,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 18:11:14,059 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 18:11:14,059 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:11:14,059 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:11:14,059 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 18:11:14,059 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:14,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,064 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:14,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,064 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:14,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,066 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,066 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:14,066 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 18:11:14,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:14,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:14,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:14,069 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 18:11:14,069 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:14,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 18:11:14,070 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 18:11:14,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:11:14,070 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:14,070 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:14,070 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,070 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151] mob files 2023-07-14 18:11:14,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e 2023-07-14 18:11:14,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151 2023-07-14 18:11:14,075 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:14,075 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:14,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:14,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:14,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:14,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:14,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 18:11:14,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,108 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:14,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:11:14,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:11:14,109 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 18:11:14,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 18:11:14,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689358273802Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689358274081 (+279 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689358274081Loading Region manifests for snaptb0-testExportFileSystemState at 1689358274081Writing data manifest for snaptb0-testExportFileSystemState at 1689358274086 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689358274102 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689358274138 (+36 ms) 2023-07-14 18:11:14,140 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 18:11:14,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 338 msec 2023-07-14 18:11:14,409 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:14,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:11:14,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:11:14,412 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412 2023-07-14 18:11:14,412 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46427, tgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412, rawTgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:14,446 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:14,446 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1554563518_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,446 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 18:11:14,473 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 18:11:14,507 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,507 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,508 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,508 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,509 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,509 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,510 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,607 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-8354272108708566609.jar 2023-07-14 18:11:14,608 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,608 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,609 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,609 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,609 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,610 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:14,610 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:11:14,610 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:11:14,611 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:11:14,611 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:11:14,611 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:11:14,612 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:11:14,612 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:11:14,612 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:11:14,613 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:11:14,613 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:11:14,614 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:14,614 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:14,614 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:14,615 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:14,615 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:14,615 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:14,616 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:15,045 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:11:15,047 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 18:11:15,050 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 18:11:17,080 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:17,081 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:17,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0001_000001 (auth:SIMPLE) 2023-07-14 18:11:17,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0002_000001 (auth:SIMPLE) 2023-07-14 18:11:17,970 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:11:21,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0002_000001 (auth:SIMPLE) 2023-07-14 18:11:24,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0002_000001 (auth:SIMPLE) 2023-07-14 18:11:27,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0002_000001 (auth:SIMPLE) 2023-07-14 18:11:29,261 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:11:29,262 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:11:29,272 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 18:11:29,272 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:11:29,273 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:11:29,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 18:11:29,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 18:11:29,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 18:11:29,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 18:11:29,274 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 18:11:29,274 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358274412/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 18:11:29,282 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 18:11:29,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-07-14 18:11:29,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 18:11:29,289 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358289289"}]},"ts":"1689358289289"} 2023-07-14 18:11:29,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 18:11:29,292 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 18:11:29,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, UNASSIGN}] 2023-07-14 18:11:29,296 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, UNASSIGN 2023-07-14 18:11:29,296 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, UNASSIGN 2023-07-14 18:11:29,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=115eb2c73a30e25f1f41b5ca290031bb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:29,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e9903dfe3c0f9846c058ac9821cc6517, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:29,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358289297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358289297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358289297"}]},"ts":"1689358289297"} 2023-07-14 18:11:29,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358289297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358289297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358289297"}]},"ts":"1689358289297"} 2023-07-14 18:11:29,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 115eb2c73a30e25f1f41b5ca290031bb, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:11:29,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure e9903dfe3c0f9846c058ac9821cc6517, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:11:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 18:11:29,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 115eb2c73a30e25f1f41b5ca290031bb, disabling compactions & flushes 2023-07-14 18:11:29,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. after waiting 0 ms 2023-07-14 18:11:29,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:29,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:29,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e9903dfe3c0f9846c058ac9821cc6517, disabling compactions & flushes 2023-07-14 18:11:29,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:29,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:29,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. after waiting 0 ms 2023-07-14 18:11:29,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:29,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:29,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:29,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:29,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb. 2023-07-14 18:11:29,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517. 2023-07-14 18:11:29,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 115eb2c73a30e25f1f41b5ca290031bb: 2023-07-14 18:11:29,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e9903dfe3c0f9846c058ac9821cc6517: 2023-07-14 18:11:29,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:29,481 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=115eb2c73a30e25f1f41b5ca290031bb, regionState=CLOSED 2023-07-14 18:11:29,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:29,481 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358289481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358289481"}]},"ts":"1689358289481"} 2023-07-14 18:11:29,482 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e9903dfe3c0f9846c058ac9821cc6517, regionState=CLOSED 2023-07-14 18:11:29,482 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689358289482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358289482"}]},"ts":"1689358289482"} 2023-07-14 18:11:29,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-14 18:11:29,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 115eb2c73a30e25f1f41b5ca290031bb, server=jenkins-hbase20.apache.org,34151,1689358246638 in 184 msec 2023-07-14 18:11:29,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-14 18:11:29,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure e9903dfe3c0f9846c058ac9821cc6517, server=jenkins-hbase20.apache.org,34403,1689358246599 in 183 msec 2023-07-14 18:11:29,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=115eb2c73a30e25f1f41b5ca290031bb, UNASSIGN in 192 msec 2023-07-14 18:11:29,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 18:11:29,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e9903dfe3c0f9846c058ac9821cc6517, UNASSIGN in 193 msec 2023-07-14 18:11:29,488 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358289488"}]},"ts":"1689358289488"} 2023-07-14 18:11:29,490 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 18:11:29,491 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 18:11:29,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 209 msec 2023-07-14 18:11:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 18:11:29,592 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 18:11:29,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-07-14 18:11:29,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 18:11:29,597 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,599 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 18:11:29,600 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,600 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,600 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,600 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 18:11:29,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 18:11:29,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 18:11:29,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:29,602 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:29,601 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:29,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 18:11:29,603 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:29,603 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:29,605 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/recovered.edits] 2023-07-14 18:11:29,605 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/recovered.edits] 2023-07-14 18:11:29,609 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/cf/06f32ce8ab3b4ef08cd8c6610a802d9b 2023-07-14 18:11:29,609 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/cf/01914b0d4fae4ef6be6b1f3ef3e3646a 2023-07-14 18:11:29,612 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517/recovered.edits/9.seqid 2023-07-14 18:11:29,612 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb/recovered.edits/9.seqid 2023-07-14 18:11:29,613 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/e9903dfe3c0f9846c058ac9821cc6517 2023-07-14 18:11:29,613 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemState/115eb2c73a30e25f1f41b5ca290031bb 2023-07-14 18:11:29,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 18:11:29,613 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 18:11:29,614 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-14 18:11:29,618 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230714f2270b270dac409fbb06739ff7d95d4e 2023-07-14 18:11:29,619 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071467cd2b4e37cf4584bbf376d485660151 2023-07-14 18:11:29,620 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 18:11:29,622 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,624 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 18:11:29,627 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 18:11:29,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,631 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 18:11:29,631 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358289631"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:29,631 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358289631"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:29,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:11:29,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 115eb2c73a30e25f1f41b5ca290031bb, NAME => 'testtb-testExportFileSystemState,,1689358272687.115eb2c73a30e25f1f41b5ca290031bb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e9903dfe3c0f9846c058ac9821cc6517, NAME => 'testtb-testExportFileSystemState,1,1689358272687.e9903dfe3c0f9846c058ac9821cc6517.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:11:29,634 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 18:11:29,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358289634"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:29,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 18:11:29,638 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 18:11:29,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-07-14 18:11:29,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 18:11:29,704 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 18:11:29,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 18:11:29,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 18:11:29,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 18:11:29,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 18:11:29,741 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 754) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:50976 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2032 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:60000 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:43835 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_952002357_1 at /127.0.0.1:42268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:57016 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_952002357_1 at /127.0.0.1:50148 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 928) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 272) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=3029 (was 3581) 2023-07-14 18:11:29,741 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 18:11:29,758 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=373, ProcessCount=173, AvailableMemoryMB=3028 2023-07-14 18:11:29,758 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 18:11:29,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:11:29,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:29,764 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:11:29,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 18:11:29,765 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:11:29,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 18:11:29,768 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:29,768 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:29,768 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 empty. 2023-07-14 18:11:29,768 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f empty. 2023-07-14 18:11:29,769 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:29,769 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:29,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 18:11:29,779 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 18:11:29,780 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec9583eba122762d692799c59614ea97, NAME => 'testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:11:29,780 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d8d4f2270d163da9401d3f11db93ec2f, NAME => 'testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:11:29,789 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:29,789 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ec9583eba122762d692799c59614ea97, disabling compactions & flushes 2023-07-14 18:11:29,789 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:29,789 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:29,789 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d8d4f2270d163da9401d3f11db93ec2f, disabling compactions & flushes 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:29,790 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. after waiting 0 ms 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. after waiting 0 ms 2023-07-14 18:11:29,790 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ec9583eba122762d692799c59614ea97: 2023-07-14 18:11:29,790 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:29,790 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d8d4f2270d163da9401d3f11db93ec2f: 2023-07-14 18:11:29,792 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:11:29,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358289793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358289793"}]},"ts":"1689358289793"} 2023-07-14 18:11:29,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358289793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358289793"}]},"ts":"1689358289793"} 2023-07-14 18:11:29,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:11:29,796 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:11:29,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358289797"}]},"ts":"1689358289797"} 2023-07-14 18:11:29,798 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 18:11:29,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:11:29,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:11:29,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:11:29,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:11:29,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:11:29,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, ASSIGN}] 2023-07-14 18:11:29,806 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, ASSIGN 2023-07-14 18:11:29,806 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, ASSIGN 2023-07-14 18:11:29,807 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:11:29,807 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34151,1689358246638; forceNewPlan=false, retain=false 2023-07-14 18:11:29,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 18:11:29,957 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:11:29,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d8d4f2270d163da9401d3f11db93ec2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:29,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ec9583eba122762d692799c59614ea97, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:29,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358289963"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358289963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358289963"}]},"ts":"1689358289963"} 2023-07-14 18:11:29,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358289963"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358289963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358289963"}]},"ts":"1689358289963"} 2023-07-14 18:11:29,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure d8d4f2270d163da9401d3f11db93ec2f, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:11:29,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ec9583eba122762d692799c59614ea97, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:11:30,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 18:11:30,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d8d4f2270d163da9401d3f11db93ec2f, NAME => 'testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:11:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec9583eba122762d692799c59614ea97, NAME => 'testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:11:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. service=AccessControlService 2023-07-14 18:11:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. service=AccessControlService 2023-07-14 18:11:30,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:11:30,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:11:30,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,128 INFO [StoreOpener-ec9583eba122762d692799c59614ea97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,129 INFO [StoreOpener-d8d4f2270d163da9401d3f11db93ec2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,130 DEBUG [StoreOpener-d8d4f2270d163da9401d3f11db93ec2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf 2023-07-14 18:11:30,130 DEBUG [StoreOpener-d8d4f2270d163da9401d3f11db93ec2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf 2023-07-14 18:11:30,130 DEBUG [StoreOpener-ec9583eba122762d692799c59614ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf 2023-07-14 18:11:30,130 DEBUG [StoreOpener-ec9583eba122762d692799c59614ea97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf 2023-07-14 18:11:30,131 INFO [StoreOpener-d8d4f2270d163da9401d3f11db93ec2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8d4f2270d163da9401d3f11db93ec2f columnFamilyName cf 2023-07-14 18:11:30,131 INFO [StoreOpener-ec9583eba122762d692799c59614ea97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec9583eba122762d692799c59614ea97 columnFamilyName cf 2023-07-14 18:11:30,132 INFO [StoreOpener-ec9583eba122762d692799c59614ea97-1] regionserver.HStore(310): Store=ec9583eba122762d692799c59614ea97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:11:30,132 INFO [StoreOpener-d8d4f2270d163da9401d3f11db93ec2f-1] regionserver.HStore(310): Store=d8d4f2270d163da9401d3f11db93ec2f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:11:30,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:30,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ec9583eba122762d692799c59614ea97 2023-07-14 18:11:30,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:11:30,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:11:30,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d8d4f2270d163da9401d3f11db93ec2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72326906, jitterRate=0.07775488495826721}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:11:30,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d8d4f2270d163da9401d3f11db93ec2f: 2023-07-14 18:11:30,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ec9583eba122762d692799c59614ea97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72773276, jitterRate=0.08440631628036499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:11:30,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ec9583eba122762d692799c59614ea97: 2023-07-14 18:11:30,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f., pid=45, masterSystemTime=1689358290118 2023-07-14 18:11:30,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97., pid=46, masterSystemTime=1689358290118 2023-07-14 18:11:30,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ec9583eba122762d692799c59614ea97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358290142"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358290142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358290142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358290142"}]},"ts":"1689358290142"} 2023-07-14 18:11:30,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d8d4f2270d163da9401d3f11db93ec2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,142 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358290142"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358290142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358290142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358290142"}]},"ts":"1689358290142"} 2023-07-14 18:11:30,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-14 18:11:30,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ec9583eba122762d692799c59614ea97, server=jenkins-hbase20.apache.org,34151,1689358246638 in 177 msec 2023-07-14 18:11:30,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-14 18:11:30,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure d8d4f2270d163da9401d3f11db93ec2f, server=jenkins-hbase20.apache.org,34403,1689358246599 in 178 msec 2023-07-14 18:11:30,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, ASSIGN in 342 msec 2023-07-14 18:11:30,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 18:11:30,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, ASSIGN in 343 msec 2023-07-14 18:11:30,149 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:11:30,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358290149"}]},"ts":"1689358290149"} 2023-07-14 18:11:30,151 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 18:11:30,153 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:11:30,153 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 18:11:30,155 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 18:11:30,156 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:30,156 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:30,156 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:30,156 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:30,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:30,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:30,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:30,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 18:11:30,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 397 msec 2023-07-14 18:11:30,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 18:11:30,372 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 18:11:30,378 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 18:11:30,378 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,381 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:11:30,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358290401 (current time:1689358290401). 2023-07-14 18:11:30,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:11:30,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x7dc3d24c to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:30,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dc21278, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:30,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,414 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dc3d24c to 127.0.0.1:57638 2023-07-14 18:11:30,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:30,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x32d7ef57 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:30,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51e50af3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:30,434 DEBUG [hconnection-0x6c098365-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,438 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,448 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32d7ef57 to 127.0.0.1:57638 2023-07-14 18:11:30,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:30,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 18:11:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:11:30,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,453 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,454 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689358890454 2023-07-14 18:11:30,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 18:11:30,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,456 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:11:30,456 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:11:30,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:30,460 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-14 18:11:30,463 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:30,464 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689358890464 2023-07-14 18:11:30,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,477 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 18:11:30,477 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,479 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 18:11:30,479 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 18:11:30,479 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,479 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,480 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,480 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,480 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,480 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 18:11:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 18:11:30,482 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,482 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,482 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,482 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,484 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,484 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,482 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,484 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,484 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,485 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,488 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,488 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,488 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,488 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,489 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,497 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,497 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,498 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,498 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,499 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,499 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d25fada[Count = 1] remaining members to acquire global barrier 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 18:11:30,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d25fada[Count = 0] remaining members to acquire global barrier 2023-07-14 18:11:30,503 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 18:11:30,503 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,507 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,507 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:30,507 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,507 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,507 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:30,507 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,508 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,508 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:11:30,508 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. started... 2023-07-14 18:11:30,508 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,508 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:11:30,508 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8d4f2270d163da9401d3f11db93ec2f: 2023-07-14 18:11:30,508 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,508 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:30,509 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:11:30,509 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,509 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,509 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,510 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:30,512 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:30,512 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,512 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. started... 2023-07-14 18:11:30,514 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec9583eba122762d692799c59614ea97: 2023-07-14 18:11:30,514 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,514 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:30,514 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:11:30,539 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. completed. 2023-07-14 18:11:30,539 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:30,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:30,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:11:30,541 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,541 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,541 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,541 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,544 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. completed. 2023-07-14 18:11:30,544 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,544 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,544 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:30,544 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,544 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,544 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:11:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,556 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:30,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 18:11:30,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:11:30,558 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:11:30,562 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,562 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,562 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,562 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:11:30,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 18:11:30,568 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 18:11:30,568 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:11:30,568 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:11:30,568 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,568 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,571 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,571 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,571 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,573 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,573 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,574 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 18:11:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,581 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:11:30,583 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,583 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,583 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,584 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,584 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,584 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,584 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,584 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:11:30,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 18:11:30,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,627 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 18:11:30,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689358290454Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689358290590 (+136 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689358290590Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689358290591 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689358290593 (+2 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689358290601 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689358290627 (+26 ms) 2023-07-14 18:11:30,630 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:30,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 174 msec 2023-07-14 18:11:30,758 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:30,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 18:11:30,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:11:30,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:11:30,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34151] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:11:30,768 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 18:11:30,768 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,768 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:11:30,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358290783 (current time:1689358290783). 2023-07-14 18:11:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:11:30,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x7c18e508 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:30,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59c18939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:30,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,800 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c18e508 to 127.0.0.1:57638 2023-07-14 18:11:30,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:30,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6cfbc96e to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:11:30,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5770515c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:11:30,818 DEBUG [hconnection-0x2ad82ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,819 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:11:30,826 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:11:30,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cfbc96e to 127.0.0.1:57638 2023-07-14 18:11:30,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:11:30,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 18:11:30,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:11:30,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,832 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,833 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689358890833 2023-07-14 18:11:30,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 18:11:30,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 18:11:30,835 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:11:30,835 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:11:30,836 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 18:11:30,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:30,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-14 18:11:30,839 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:30,840 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689358890840 2023-07-14 18:11:30,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 18:11:30,854 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 18:11:30,854 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,855 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 18:11:30,855 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 18:11:30,856 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,856 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,856 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,856 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,856 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,857 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,857 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,858 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,858 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,858 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 18:11:30,858 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,860 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,859 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:11:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,864 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 18:11:30,864 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 18:11:30,864 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 18:11:30,872 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,873 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,873 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,873 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,873 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,874 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:11:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53113605[Count = 1] remaining members to acquire global barrier 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 18:11:30,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53113605[Count = 0] remaining members to acquire global barrier 2023-07-14 18:11:30,878 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 18:11:30,878 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,879 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,879 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,879 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,879 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:11:30,879 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:11:30,880 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 18:11:30,880 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,880 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,880 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,881 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:30,882 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:30,882 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,882 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:11:30,882 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:11:30,882 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,882 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. started... 2023-07-14 18:11:30,882 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. started... 2023-07-14 18:11:30,883 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d8d4f2270d163da9401d3f11db93ec2f 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 18:11:30,883 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec9583eba122762d692799c59614ea97 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 18:11:30,887 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 18:11:30,907 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb 2023-07-14 18:11:30,920 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/.tmp/cf/bf08d1716e074c7e80f41e82c49c46f3 2023-07-14 18:11:30,921 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7 2023-07-14 18:11:30,929 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/.tmp/cf/bf08d1716e074c7e80f41e82c49c46f3 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3 2023-07-14 18:11:30,931 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/.tmp/cf/b7ba73c5981b49e0a9ec56994a763156 2023-07-14 18:11:30,935 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:30,935 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 18:11:30,936 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d8d4f2270d163da9401d3f11db93ec2f in 53ms, sequenceid=6, compaction requested=false 2023-07-14 18:11:30,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 18:11:30,937 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8d4f2270d163da9401d3f11db93ec2f: 2023-07-14 18:11:30,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:11:30,938 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 18:11:30,938 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:30,938 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:11:30,938 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3] hfiles 2023-07-14 18:11:30,938 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 18:11:30,939 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/.tmp/cf/b7ba73c5981b49e0a9ec56994a763156 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156 2023-07-14 18:11:30,944 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156, entries=45, sequenceid=6, filesize=12.4 K 2023-07-14 18:11:30,945 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ec9583eba122762d692799c59614ea97 in 62ms, sequenceid=6, compaction requested=false 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec9583eba122762d692799c59614ea97: 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. completed. 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:11:30,946 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156] hfiles 2023-07-14 18:11:30,946 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:30,946 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 18:11:30,946 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,946 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,946 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:11:30,948 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,948 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,948 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,948 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:11:30,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 18:11:30,955 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. completed. 2023-07-14 18:11:30,955 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:30,955 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:11:30,955 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:11:30,955 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,955 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 18:11:30,955 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:11:30,972 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 18:11:30,972 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,973 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 18:11:30,972 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:11:30,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 18:11:30,978 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 18:11:30,978 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:11:30,978 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:11:30,978 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 18:11:30,978 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,979 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:11:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:11:30,980 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,985 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:11:30,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:11:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,987 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,987 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:11:30,987 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 18:11:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:11:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:11:30,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 18:11:30,991 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:30,991 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:11:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:11:30,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 18:11:30,992 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,993 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:30,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:11:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,993 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:11:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:11:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:11:30,993 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,994 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 18:11:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb] mob files 2023-07-14 18:11:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7 2023-07-14 18:11:30,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb 2023-07-14 18:11:31,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 18:11:31,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 18:11:31,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,067 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689358290833Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689358291005 (+172 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689358291005Loading Region manifests for snaptb0-testConsecutiveExports at 1689358291005Writing data manifest for snaptb0-testConsecutiveExports at 1689358291008 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689358291023 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689358291066 (+43 ms) 2023-07-14 18:11:31,069 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 18:11:31,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 235 msec 2023-07-14 18:11:31,138 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:11:31,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 18:11:31,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:11:31,140 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139 2023-07-14 18:11:31,140 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:31,158 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:31,158 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@139e7493, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,158 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 18:11:31,166 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:31,176 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,176 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,177 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,177 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,177 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,178 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,178 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,244 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-3592018945540361760.jar 2023-07-14 18:11:31,245 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,245 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,245 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,246 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,246 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,247 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:31,247 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:11:31,248 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:11:31,248 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:11:31,249 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:11:31,249 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:11:31,250 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:11:31,250 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:11:31,251 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:11:31,251 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:11:31,252 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:11:31,252 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:31,253 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:31,253 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:31,254 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:31,254 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:31,255 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:31,255 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:31,648 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:11:31,651 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 18:11:31,653 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 18:11:33,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:33,964 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:33,969 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0002_000001 (auth:SIMPLE) 2023-07-14 18:11:34,365 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0003_000001 (auth:SIMPLE) 2023-07-14 18:11:35,078 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:11:38,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0003_000001 (auth:SIMPLE) 2023-07-14 18:11:40,364 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0003_000001 (auth:SIMPLE) 2023-07-14 18:11:42,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0003_000001 (auth:SIMPLE) 2023-07-14 18:11:44,868 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:11:44,868 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:11:44,872 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 18:11:44,872 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:11:44,873 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:11:44,873 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 18:11:44,875 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 18:11:44,875 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 18:11:44,875 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@79caaae7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 18:11:44,875 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 18:11:44,875 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 18:11:44,876 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:44,894 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:11:44,895 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6385004c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:44,895 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 18:11:44,906 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 18:11:44,916 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,916 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,917 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,917 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,917 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,918 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,918 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,981 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-2014428041484910508.jar 2023-07-14 18:11:44,982 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,982 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,982 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,983 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,983 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,983 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:11:44,984 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:11:44,984 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:11:44,984 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:11:44,985 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:11:44,985 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:11:44,985 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:11:44,986 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:11:44,986 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:11:44,986 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:11:44,987 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:11:44,987 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:44,987 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:44,988 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:44,988 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:44,988 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:11:44,988 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:44,989 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:11:45,366 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:11:45,369 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 18:11:45,372 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 18:11:49,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:49,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:11:49,092 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0003_000001 (auth:SIMPLE) 2023-07-14 18:11:49,976 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0004_000001 (auth:SIMPLE) 2023-07-14 18:11:53,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0004_000001 (auth:SIMPLE) 2023-07-14 18:11:55,908 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0004_000001 (auth:SIMPLE) 2023-07-14 18:11:58,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0004_000001 (auth:SIMPLE) 2023-07-14 18:11:59,584 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:11:59,584 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:11:59,587 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 18:11:59,587 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:11:59,587 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:11:59,587 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 18:11:59,590 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 18:11:59,590 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 18:11:59,590 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@79caaae7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 18:11:59,590 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 18:11:59,590 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/local-export-1689358291139/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 18:11:59,601 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 18:11:59,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-07-14 18:11:59,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 18:11:59,607 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358319607"}]},"ts":"1689358319607"} 2023-07-14 18:11:59,609 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 18:11:59,610 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 18:11:59,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, UNASSIGN}] 2023-07-14 18:11:59,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, UNASSIGN 2023-07-14 18:11:59,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d8d4f2270d163da9401d3f11db93ec2f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:11:59,616 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358319616"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358319616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358319616"}]},"ts":"1689358319616"} 2023-07-14 18:11:59,617 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, UNASSIGN 2023-07-14 18:11:59,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure d8d4f2270d163da9401d3f11db93ec2f, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:11:59,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ec9583eba122762d692799c59614ea97, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:11:59,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358319618"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358319618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358319618"}]},"ts":"1689358319618"} 2023-07-14 18:11:59,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ec9583eba122762d692799c59614ea97, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:11:59,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 18:11:59,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d8d4f2270d163da9401d3f11db93ec2f, disabling compactions & flushes 2023-07-14 18:11:59,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. after waiting 0 ms 2023-07-14 18:11:59,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:59,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ec9583eba122762d692799c59614ea97 2023-07-14 18:11:59,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ec9583eba122762d692799c59614ea97, disabling compactions & flushes 2023-07-14 18:11:59,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:59,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:59,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. after waiting 0 ms 2023-07-14 18:11:59,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:59,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:59,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:11:59,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:59,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f. 2023-07-14 18:11:59,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d8d4f2270d163da9401d3f11db93ec2f: 2023-07-14 18:11:59,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:11:59,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97. 2023-07-14 18:11:59,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ec9583eba122762d692799c59614ea97: 2023-07-14 18:11:59,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:59,789 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d8d4f2270d163da9401d3f11db93ec2f, regionState=CLOSED 2023-07-14 18:11:59,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358319789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358319789"}]},"ts":"1689358319789"} 2023-07-14 18:11:59,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ec9583eba122762d692799c59614ea97 2023-07-14 18:11:59,790 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ec9583eba122762d692799c59614ea97, regionState=CLOSED 2023-07-14 18:11:59,790 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689358319790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358319790"}]},"ts":"1689358319790"} 2023-07-14 18:11:59,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-14 18:11:59,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure d8d4f2270d163da9401d3f11db93ec2f, server=jenkins-hbase20.apache.org,34403,1689358246599 in 173 msec 2023-07-14 18:11:59,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-14 18:11:59,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ec9583eba122762d692799c59614ea97, server=jenkins-hbase20.apache.org,34151,1689358246638 in 172 msec 2023-07-14 18:11:59,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d8d4f2270d163da9401d3f11db93ec2f, UNASSIGN in 180 msec 2023-07-14 18:11:59,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-14 18:11:59,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ec9583eba122762d692799c59614ea97, UNASSIGN in 181 msec 2023-07-14 18:11:59,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358319794"}]},"ts":"1689358319794"} 2023-07-14 18:11:59,795 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 18:11:59,796 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 18:11:59,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 194 msec 2023-07-14 18:11:59,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 18:11:59,909 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 18:11:59,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-07-14 18:11:59,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 18:11:59,913 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,918 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 18:11:59,919 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,919 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,919 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,919 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 18:11:59,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 18:11:59,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 18:11:59,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:59,920 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 18:11:59,921 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:11:59,921 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:59,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 18:11:59,922 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:59,924 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/recovered.edits] 2023-07-14 18:11:59,924 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/recovered.edits] 2023-07-14 18:11:59,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/cf/bf08d1716e074c7e80f41e82c49c46f3 2023-07-14 18:11:59,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/cf/b7ba73c5981b49e0a9ec56994a763156 2023-07-14 18:11:59,929 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f/recovered.edits/9.seqid 2023-07-14 18:11:59,929 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97/recovered.edits/9.seqid 2023-07-14 18:11:59,929 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/d8d4f2270d163da9401d3f11db93ec2f 2023-07-14 18:11:59,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testConsecutiveExports/ec9583eba122762d692799c59614ea97 2023-07-14 18:11:59,930 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 18:11:59,930 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 18:11:59,931 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-14 18:11:59,934 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714a729d994421e4f8e884bac4bee04c9a7 2023-07-14 18:11:59,935 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071490e3a2ff1f634fec95640cc6c3fca9bb 2023-07-14 18:11:59,935 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 18:11:59,937 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,939 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 18:11:59,941 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 18:11:59,942 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,942 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 18:11:59,942 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358319942"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:59,942 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358319942"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:59,944 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:11:59,944 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d8d4f2270d163da9401d3f11db93ec2f, NAME => 'testtb-testConsecutiveExports,,1689358289759.d8d4f2270d163da9401d3f11db93ec2f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ec9583eba122762d692799c59614ea97, NAME => 'testtb-testConsecutiveExports,1,1689358289759.ec9583eba122762d692799c59614ea97.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:11:59,944 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 18:11:59,944 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358319944"}]},"ts":"9223372036854775807"} 2023-07-14 18:11:59,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 18:11:59,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 18:11:59,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 38 msec 2023-07-14 18:12:00,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 18:12:00,023 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 18:12:00,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 18:12:00,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 18:12:00,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 18:12:00,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 18:12:00,067 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 763), OpenFileDescriptor=903 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=344 (was 373), ProcessCount=173 (was 173), AvailableMemoryMB=2520 (was 3028) 2023-07-14 18:12:00,067 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-14 18:12:00,085 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=173, AvailableMemoryMB=2520 2023-07-14 18:12:00,085 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-14 18:12:00,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:12:00,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:12:00,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 18:12:00,091 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:12:00,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 18:12:00,094 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,095 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,095 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f empty. 2023-07-14 18:12:00,095 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 empty. 2023-07-14 18:12:00,096 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,096 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 18:12:00,114 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 18:12:00,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27fc374f37023ec10626af9c1cb90a7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:00,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b8c8dfc474a9ca17197a4e62c343eb01, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 27fc374f37023ec10626af9c1cb90a7f, disabling compactions & flushes 2023-07-14 18:12:00,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. after waiting 0 ms 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 27fc374f37023ec10626af9c1cb90a7f: 2023-07-14 18:12:00,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b8c8dfc474a9ca17197a4e62c343eb01, disabling compactions & flushes 2023-07-14 18:12:00,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. after waiting 0 ms 2023-07-14 18:12:00,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b8c8dfc474a9ca17197a4e62c343eb01: 2023-07-14 18:12:00,128 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:12:00,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358320128"}]},"ts":"1689358320128"} 2023-07-14 18:12:00,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358320128"}]},"ts":"1689358320128"} 2023-07-14 18:12:00,134 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:12:00,135 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:12:00,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358320135"}]},"ts":"1689358320135"} 2023-07-14 18:12:00,137 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 18:12:00,139 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:12:00,140 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:12:00,140 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:12:00,140 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:12:00,140 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:12:00,141 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, ASSIGN}] 2023-07-14 18:12:00,143 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, ASSIGN 2023-07-14 18:12:00,143 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, ASSIGN 2023-07-14 18:12:00,144 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38741,1689358246539; forceNewPlan=false, retain=false 2023-07-14 18:12:00,144 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34151,1689358246638; forceNewPlan=false, retain=false 2023-07-14 18:12:00,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 18:12:00,294 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:12:00,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=27fc374f37023ec10626af9c1cb90a7f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b8c8dfc474a9ca17197a4e62c343eb01, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,298 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358320297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358320297"}]},"ts":"1689358320297"} 2023-07-14 18:12:00,298 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358320297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358320297"}]},"ts":"1689358320297"} 2023-07-14 18:12:00,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 27fc374f37023ec10626af9c1cb90a7f, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:00,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure b8c8dfc474a9ca17197a4e62c343eb01, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:00,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 18:12:00,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27fc374f37023ec10626af9c1cb90a7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:12:00,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b8c8dfc474a9ca17197a4e62c343eb01, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:12:00,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. service=AccessControlService 2023-07-14 18:12:00,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. service=AccessControlService 2023-07-14 18:12:00,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:00,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:00,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,460 INFO [StoreOpener-b8c8dfc474a9ca17197a4e62c343eb01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,460 INFO [StoreOpener-27fc374f37023ec10626af9c1cb90a7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,461 DEBUG [StoreOpener-b8c8dfc474a9ca17197a4e62c343eb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf 2023-07-14 18:12:00,461 DEBUG [StoreOpener-b8c8dfc474a9ca17197a4e62c343eb01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf 2023-07-14 18:12:00,461 DEBUG [StoreOpener-27fc374f37023ec10626af9c1cb90a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf 2023-07-14 18:12:00,461 DEBUG [StoreOpener-27fc374f37023ec10626af9c1cb90a7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf 2023-07-14 18:12:00,462 INFO [StoreOpener-b8c8dfc474a9ca17197a4e62c343eb01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8c8dfc474a9ca17197a4e62c343eb01 columnFamilyName cf 2023-07-14 18:12:00,462 INFO [StoreOpener-27fc374f37023ec10626af9c1cb90a7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27fc374f37023ec10626af9c1cb90a7f columnFamilyName cf 2023-07-14 18:12:00,464 INFO [StoreOpener-27fc374f37023ec10626af9c1cb90a7f-1] regionserver.HStore(310): Store=27fc374f37023ec10626af9c1cb90a7f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:00,464 INFO [StoreOpener-b8c8dfc474a9ca17197a4e62c343eb01-1] regionserver.HStore(310): Store=b8c8dfc474a9ca17197a4e62c343eb01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:00,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:00,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:00,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:00,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:00,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b8c8dfc474a9ca17197a4e62c343eb01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60485639, jitterRate=-0.09869374334812164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:00,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 27fc374f37023ec10626af9c1cb90a7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65033553, jitterRate=-0.030924543738365173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:00,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b8c8dfc474a9ca17197a4e62c343eb01: 2023-07-14 18:12:00,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 27fc374f37023ec10626af9c1cb90a7f: 2023-07-14 18:12:00,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01., pid=61, masterSystemTime=1689358320451 2023-07-14 18:12:00,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f., pid=60, masterSystemTime=1689358320451 2023-07-14 18:12:00,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,477 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b8c8dfc474a9ca17197a4e62c343eb01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358320477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358320477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358320477"}]},"ts":"1689358320477"} 2023-07-14 18:12:00,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=27fc374f37023ec10626af9c1cb90a7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358320478"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358320478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358320478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358320478"}]},"ts":"1689358320478"} 2023-07-14 18:12:00,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-14 18:12:00,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure b8c8dfc474a9ca17197a4e62c343eb01, server=jenkins-hbase20.apache.org,34151,1689358246638 in 180 msec 2023-07-14 18:12:00,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-14 18:12:00,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 27fc374f37023ec10626af9c1cb90a7f, server=jenkins-hbase20.apache.org,38741,1689358246539 in 182 msec 2023-07-14 18:12:00,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, ASSIGN in 341 msec 2023-07-14 18:12:00,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-14 18:12:00,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, ASSIGN in 342 msec 2023-07-14 18:12:00,485 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:12:00,485 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358320485"}]},"ts":"1689358320485"} 2023-07-14 18:12:00,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 18:12:00,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:12:00,490 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 18:12:00,493 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 18:12:00,502 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:00,502 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:00,502 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:00,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:00,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:00,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:00,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:00,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:00,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 418 msec 2023-07-14 18:12:00,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 18:12:00,696 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 18:12:00,702 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,702 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,708 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:00,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:00,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358320727 (current time:1689358320727). 2023-07-14 18:12:00,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:00,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x47d9cb31 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:00,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17efd5f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:00,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:00,736 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:00,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47d9cb31 to 127.0.0.1:57638 2023-07-14 18:12:00,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:00,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x683e0b02 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:00,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6137c577, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:00,763 DEBUG [hconnection-0x81e84b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:00,766 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:00,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:00,774 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:00,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x683e0b02 to 127.0.0.1:57638 2023-07-14 18:12:00,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:00,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 18:12:00,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:00,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:00,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:00,781 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:00,782 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689358920782 2023-07-14 18:12:00,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:00,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,783 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:00,783 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:00,785 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:00,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:00,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-14 18:12:00,787 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:00,788 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689358920788 2023-07-14 18:12:00,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,797 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 18:12:00,797 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:00,798 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 18:12:00,798 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 18:12:00,799 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,799 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,800 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,800 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,800 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,800 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,801 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,801 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:00,801 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:00,801 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:00,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,803 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:00,803 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:00,803 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:00,801 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:00,803 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:00,804 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:00,804 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:00,805 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:00,805 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:00,805 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:00,805 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:00,805 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:00,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:00,811 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,811 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,812 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,812 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,812 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,812 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:00,812 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,812 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:00,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 18:12:00,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa51f62[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 18:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa51f62[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:00,817 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 18:12:00,817 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,821 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,822 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:00,821 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:00,822 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:00,822 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,822 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:00,822 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:00,822 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,822 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. started... 2023-07-14 18:12:00,822 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:00,822 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,822 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8c8dfc474a9ca17197a4e62c343eb01: 2023-07-14 18:12:00,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,824 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:00,824 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:00,824 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:00,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. started... 2023-07-14 18:12:00,825 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27fc374f37023ec10626af9c1cb90a7f: 2023-07-14 18:12:00,825 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,825 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:00,825 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:00,828 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:00,828 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:00,828 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:00,836 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. completed. 2023-07-14 18:12:00,836 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:00,836 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. completed. 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:00,836 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:00,836 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:00,838 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:00,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:00,838 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:00,838 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,840 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:00,838 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:00,840 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:12:00,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 18:12:00,847 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 18:12:00,847 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:00,847 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:00,848 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,848 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,849 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:00,849 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,850 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,850 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,852 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:00,852 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,852 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,855 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,855 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,856 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,856 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:00,856 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:00,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:00,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:00,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:00,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:12:00,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,883 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:00,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 18:12:00,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:00,885 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:00,889 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 18:12:00,902 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 18:12:00,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,902 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:00,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689358320782Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689358320864 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689358320864Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689358320864Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689358320868 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689358320878 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689358320902 (+24 ms) 2023-07-14 18:12:00,905 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:00,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 122 msec 2023-07-14 18:12:01,085 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:01,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 18:12:01,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:01,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38741] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:01,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34151] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:01,101 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,101 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:01,101 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:01,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358321113 (current time:1689358321113). 2023-07-14 18:12:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:01,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6480f35f to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:01,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb43b75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:01,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:01,125 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6480f35f to 127.0.0.1:57638 2023-07-14 18:12:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x287c0244 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:01,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b85161f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:01,134 DEBUG [hconnection-0x627f389-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:01,138 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:01,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:01,147 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:01,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x287c0244 to 127.0.0.1:57638 2023-07-14 18:12:01,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:01,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 18:12:01,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:01,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:01,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:01,153 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:01,154 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689358921154 2023-07-14 18:12:01,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 18:12:01,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,156 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:01,156 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:01,157 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 18:12:01,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:01,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-14 18:12:01,159 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:01,160 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689358921159 2023-07-14 18:12:01,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,167 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 18:12:01,167 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:01,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 18:12:01,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 18:12:01,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,170 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,170 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,170 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,170 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,171 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,171 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,172 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,172 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:01,172 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,173 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:01,174 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 18:12:01,174 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:01,173 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:01,175 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:01,174 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:01,176 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 18:12:01,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,180 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226a0c4d[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 18:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@226a0c4d[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:01,184 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 18:12:01,184 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,188 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 18:12:01,189 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,189 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:01,189 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. started... 2023-07-14 18:12:01,189 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:01,189 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:01,189 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b8c8dfc474a9ca17197a4e62c343eb01 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:01,189 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. started... 2023-07-14 18:12:01,189 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:01,190 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 27fc374f37023ec10626af9c1cb90a7f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 18:12:01,191 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:01,191 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:01,191 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:01,212 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541 2023-07-14 18:12:01,212 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874 2023-07-14 18:12:01,221 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/.tmp/cf/fdbc787e52924034b8131e079f1868ae 2023-07-14 18:12:01,221 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/.tmp/cf/4d92e180599444728108fba35f6efe2e 2023-07-14 18:12:01,227 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/.tmp/cf/4d92e180599444728108fba35f6efe2e as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e 2023-07-14 18:12:01,227 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/.tmp/cf/fdbc787e52924034b8131e079f1868ae as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae 2023-07-14 18:12:01,233 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae, entries=3, sequenceid=6, filesize=5.4 K 2023-07-14 18:12:01,234 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e, entries=47, sequenceid=6, filesize=13.5 K 2023-07-14 18:12:01,234 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 27fc374f37023ec10626af9c1cb90a7f in 44ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27fc374f37023ec10626af9c1cb90a7f: 2023-07-14 18:12:01,236 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b8c8dfc474a9ca17197a4e62c343eb01 in 47ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b8c8dfc474a9ca17197a4e62c343eb01: 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae] hfiles 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,236 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,237 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:01,237 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e] hfiles 2023-07-14 18:12:01,237 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,244 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. completed. 2023-07-14 18:12:01,245 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:01,245 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. completed. 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:01,245 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 18:12:01,245 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:01,246 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,246 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:01,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:01,246 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:01,246 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:01,248 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:01,248 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 18:12:01,248 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:01,248 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 18:12:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:01,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:01,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,257 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:12:01,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 18:12:01,257 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 18:12:01,257 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:01,257 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:01,257 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,257 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:01,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 18:12:01,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:01,259 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:01,263 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,263 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,263 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,264 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,265 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:01,266 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,266 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:01,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,268 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:01,269 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,269 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:01,272 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:01,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:01,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:01,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:01,274 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,275 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:01,275 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,275 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,275 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541] mob files 2023-07-14 18:12:01,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874 2023-07-14 18:12:01,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541 2023-07-14 18:12:01,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 18:12:01,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,336 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:01,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689358321154Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689358321288 (+134 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689358321288Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689358321288Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689358321291 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689358321306 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689358321336 (+30 ms) 2023-07-14 18:12:01,339 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 18:12:01,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 184 msec 2023-07-14 18:12:01,459 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:01,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 18:12:01,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:01,490 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:12:01,493 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:12:01,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34151] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 18:12:01,495 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:12:01,498 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:12:01,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 18:12:01,498 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 18:12:01,504 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 18:12:01,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38741] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 18:12:01,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 18:12:01,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:01,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:12:01,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 18:12:01,511 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:12:01,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 18:12:01,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,513 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,513 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 empty. 2023-07-14 18:12:01,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 empty. 2023-07-14 18:12:01,514 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 18:12:01,525 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 18:12:01,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a6476e69dfc76b2fc6dad991bcef106, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:01,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8270958232f420a433acef4d267ed5a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1a6476e69dfc76b2fc6dad991bcef106, disabling compactions & flushes 2023-07-14 18:12:01,540 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. after waiting 0 ms 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,540 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,540 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1a6476e69dfc76b2fc6dad991bcef106: 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8270958232f420a433acef4d267ed5a7, disabling compactions & flushes 2023-07-14 18:12:01,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. after waiting 0 ms 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,543 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,543 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8270958232f420a433acef4d267ed5a7: 2023-07-14 18:12:01,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:12:01,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358321546"}]},"ts":"1689358321546"} 2023-07-14 18:12:01,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358321546"}]},"ts":"1689358321546"} 2023-07-14 18:12:01,548 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:12:01,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:12:01,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358321549"}]},"ts":"1689358321549"} 2023-07-14 18:12:01,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 18:12:01,552 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:12:01,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:12:01,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:12:01,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:12:01,553 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:12:01,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, ASSIGN}] 2023-07-14 18:12:01,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, ASSIGN 2023-07-14 18:12:01,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, ASSIGN 2023-07-14 18:12:01,556 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38741,1689358246539; forceNewPlan=false, retain=false 2023-07-14 18:12:01,556 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34151,1689358246638; forceNewPlan=false, retain=false 2023-07-14 18:12:01,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 18:12:01,706 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:12:01,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1a6476e69dfc76b2fc6dad991bcef106, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8270958232f420a433acef4d267ed5a7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321709"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358321709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358321709"}]},"ts":"1689358321709"} 2023-07-14 18:12:01,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321709"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358321709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358321709"}]},"ts":"1689358321709"} 2023-07-14 18:12:01,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 1a6476e69dfc76b2fc6dad991bcef106, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:01,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 8270958232f420a433acef4d267ed5a7, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:01,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 18:12:01,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a6476e69dfc76b2fc6dad991bcef106, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 18:12:01,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. service=AccessControlService 2023-07-14 18:12:01,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:01,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8270958232f420a433acef4d267ed5a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. service=AccessControlService 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:01,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,871 INFO [StoreOpener-1a6476e69dfc76b2fc6dad991bcef106-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,871 INFO [StoreOpener-8270958232f420a433acef4d267ed5a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,873 DEBUG [StoreOpener-1a6476e69dfc76b2fc6dad991bcef106-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf 2023-07-14 18:12:01,873 DEBUG [StoreOpener-1a6476e69dfc76b2fc6dad991bcef106-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf 2023-07-14 18:12:01,873 DEBUG [StoreOpener-8270958232f420a433acef4d267ed5a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf 2023-07-14 18:12:01,873 DEBUG [StoreOpener-8270958232f420a433acef4d267ed5a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf 2023-07-14 18:12:01,873 INFO [StoreOpener-8270958232f420a433acef4d267ed5a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8270958232f420a433acef4d267ed5a7 columnFamilyName cf 2023-07-14 18:12:01,873 INFO [StoreOpener-1a6476e69dfc76b2fc6dad991bcef106-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a6476e69dfc76b2fc6dad991bcef106 columnFamilyName cf 2023-07-14 18:12:01,874 INFO [StoreOpener-1a6476e69dfc76b2fc6dad991bcef106-1] regionserver.HStore(310): Store=1a6476e69dfc76b2fc6dad991bcef106/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:01,874 INFO [StoreOpener-8270958232f420a433acef4d267ed5a7-1] regionserver.HStore(310): Store=8270958232f420a433acef4d267ed5a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:01,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:01,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:01,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:01,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:01,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8270958232f420a433acef4d267ed5a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59955246, jitterRate=-0.10659721493721008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:01,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1a6476e69dfc76b2fc6dad991bcef106; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72145082, jitterRate=0.07504549622535706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:01,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8270958232f420a433acef4d267ed5a7: 2023-07-14 18:12:01,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1a6476e69dfc76b2fc6dad991bcef106: 2023-07-14 18:12:01,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7., pid=70, masterSystemTime=1689358321865 2023-07-14 18:12:01,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106., pid=69, masterSystemTime=1689358321863 2023-07-14 18:12:01,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:01,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8270958232f420a433acef4d267ed5a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:01,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321884"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358321884"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358321884"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358321884"}]},"ts":"1689358321884"} 2023-07-14 18:12:01,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:01,885 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1a6476e69dfc76b2fc6dad991bcef106, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:01,885 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358321885"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358321885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358321885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358321885"}]},"ts":"1689358321885"} 2023-07-14 18:12:01,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-14 18:12:01,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 8270958232f420a433acef4d267ed5a7, server=jenkins-hbase20.apache.org,34151,1689358246638 in 174 msec 2023-07-14 18:12:01,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-14 18:12:01,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 1a6476e69dfc76b2fc6dad991bcef106, server=jenkins-hbase20.apache.org,38741,1689358246539 in 175 msec 2023-07-14 18:12:01,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, ASSIGN in 334 msec 2023-07-14 18:12:01,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 18:12:01,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, ASSIGN in 335 msec 2023-07-14 18:12:01,891 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:12:01,891 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358321891"}]},"ts":"1689358321891"} 2023-07-14 18:12:01,892 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 18:12:01,894 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:12:01,894 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 18:12:01,896 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 18:12:01,897 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:01,897 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:01,897 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:01,897 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:01,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 392 msec 2023-07-14 18:12:02,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 18:12:02,117 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 18:12:02,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions 1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:02,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7], force=true 2023-07-14 18:12:02,156 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7], force=true 2023-07-14 18:12:02,156 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7], force=true 2023-07-14 18:12:02,156 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7], force=true 2023-07-14 18:12:02,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 18:12:02,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, UNASSIGN}] 2023-07-14 18:12:02,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, UNASSIGN 2023-07-14 18:12:02,181 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, UNASSIGN 2023-07-14 18:12:02,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8270958232f420a433acef4d267ed5a7, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:02,181 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1a6476e69dfc76b2fc6dad991bcef106, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:02,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358322181"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358322181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358322181"}]},"ts":"1689358322181"} 2023-07-14 18:12:02,181 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358322181"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358322181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358322181"}]},"ts":"1689358322181"} 2023-07-14 18:12:02,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 8270958232f420a433acef4d267ed5a7, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:02,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 1a6476e69dfc76b2fc6dad991bcef106, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:02,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 18:12:02,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:02,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8270958232f420a433acef4d267ed5a7, disabling compactions & flushes 2023-07-14 18:12:02,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:02,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:02,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. after waiting 0 ms 2023-07-14 18:12:02,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:02,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 8270958232f420a433acef4d267ed5a7 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 18:12:02,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:02,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1a6476e69dfc76b2fc6dad991bcef106, disabling compactions & flushes 2023-07-14 18:12:02,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. after waiting 0 ms 2023-07-14 18:12:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:02,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1a6476e69dfc76b2fc6dad991bcef106 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 18:12:02,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/.tmp/cf/f523ba42af6e4d6bb5401f16e53e62e2 2023-07-14 18:12:02,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/.tmp/cf/0d841567363241f297c0a4588f0a4115 2023-07-14 18:12:02,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/.tmp/cf/0d841567363241f297c0a4588f0a4115 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115 2023-07-14 18:12:02,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/.tmp/cf/f523ba42af6e4d6bb5401f16e53e62e2 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2 2023-07-14 18:12:02,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 18:12:02,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 18:12:02,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1a6476e69dfc76b2fc6dad991bcef106 in 30ms, sequenceid=5, compaction requested=false 2023-07-14 18:12:02,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8270958232f420a433acef4d267ed5a7 in 33ms, sequenceid=5, compaction requested=false 2023-07-14 18:12:02,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 18:12:02,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 18:12:02,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 18:12:02,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 18:12:02,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:02,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:02,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7. 2023-07-14 18:12:02,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106. 2023-07-14 18:12:02,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8270958232f420a433acef4d267ed5a7: 2023-07-14 18:12:02,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1a6476e69dfc76b2fc6dad991bcef106: 2023-07-14 18:12:02,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:02,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8270958232f420a433acef4d267ed5a7, regionState=CLOSED 2023-07-14 18:12:02,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358322385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358322385"}]},"ts":"1689358322385"} 2023-07-14 18:12:02,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:02,386 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1a6476e69dfc76b2fc6dad991bcef106, regionState=CLOSED 2023-07-14 18:12:02,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689358322386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358322386"}]},"ts":"1689358322386"} 2023-07-14 18:12:02,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-14 18:12:02,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 8270958232f420a433acef4d267ed5a7, server=jenkins-hbase20.apache.org,34151,1689358246638 in 204 msec 2023-07-14 18:12:02,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-14 18:12:02,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8270958232f420a433acef4d267ed5a7, UNASSIGN in 210 msec 2023-07-14 18:12:02,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 1a6476e69dfc76b2fc6dad991bcef106, server=jenkins-hbase20.apache.org,38741,1689358246539 in 205 msec 2023-07-14 18:12:02,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 18:12:02,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1a6476e69dfc76b2fc6dad991bcef106, UNASSIGN in 214 msec 2023-07-14 18:12:02,431 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 18:12:02,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321506.1a6476e69dfc76b2fc6dad991bcef106.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:02,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689358321506.8270958232f420a433acef4d267ed5a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:02,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:02,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 18:12:02,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, ASSIGN}] 2023-07-14 18:12:02,476 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, ASSIGN 2023-07-14 18:12:02,476 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,38741,1689358246539; forceNewPlan=false, retain=false 2023-07-14 18:12:02,627 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 18:12:02,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=861078e14400e65f9fe69fdbb6490ceb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:02,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689358322628"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358322628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358322628"}]},"ts":"1689358322628"} 2023-07-14 18:12:02,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 861078e14400e65f9fe69fdbb6490ceb, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:02,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 18:12:02,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:02,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 861078e14400e65f9fe69fdbb6490ceb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.', STARTKEY => '', ENDKEY => ''} 2023-07-14 18:12:02,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. service=AccessControlService 2023-07-14 18:12:02,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/.regioninfo 2023-07-14 18:12:02,797 INFO [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,798 DEBUG [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf 2023-07-14 18:12:02,798 DEBUG [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf 2023-07-14 18:12:02,798 INFO [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 861078e14400e65f9fe69fdbb6490ceb columnFamilyName cf 2023-07-14 18:12:02,826 DEBUG [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/0d841567363241f297c0a4588f0a4115.1a6476e69dfc76b2fc6dad991bcef106->hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115-top 2023-07-14 18:12:02,831 DEBUG [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/f523ba42af6e4d6bb5401f16e53e62e2.8270958232f420a433acef4d267ed5a7->hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2-top 2023-07-14 18:12:02,832 INFO [StoreOpener-861078e14400e65f9fe69fdbb6490ceb-1] regionserver.HStore(310): Store=861078e14400e65f9fe69fdbb6490ceb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:02,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:02,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 861078e14400e65f9fe69fdbb6490ceb; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66933461, jitterRate=-0.0026137083768844604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:02,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 861078e14400e65f9fe69fdbb6490ceb: 2023-07-14 18:12:02,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb., pid=77, masterSystemTime=1689358322782 2023-07-14 18:12:02,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.,because compaction is disabled. 2023-07-14 18:12:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:02,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:02,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=861078e14400e65f9fe69fdbb6490ceb, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:02,841 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689358322841"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358322841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358322841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358322841"}]},"ts":"1689358322841"} 2023-07-14 18:12:02,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 18:12:02,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 861078e14400e65f9fe69fdbb6490ceb, server=jenkins-hbase20.apache.org,38741,1689358246539 in 213 msec 2023-07-14 18:12:02,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 18:12:02,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, ASSIGN in 369 msec 2023-07-14 18:12:02,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1a6476e69dfc76b2fc6dad991bcef106, 8270958232f420a433acef4d267ed5a7], force=true in 695 msec 2023-07-14 18:12:03,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 18:12:03,264 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 18:12:03,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 18:12:03,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358323265 (current time:1689358323265). 2023-07-14 18:12:03,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:03,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x77f48cd1 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:03,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@319898bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:03,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:03,274 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:03,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f48cd1 to 127.0.0.1:57638 2023-07-14 18:12:03,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:03,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x34bc6891 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:03,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@677df8d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:03,283 DEBUG [hconnection-0x12d5c9e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:03,285 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:03,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:03,291 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:03,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34bc6891 to 127.0.0.1:57638 2023-07-14 18:12:03,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:03,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 18:12:03,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:03,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 18:12:03,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 18:12:03,296 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 18:12:03,297 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689358923297 2023-07-14 18:12:03,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 18:12:03,300 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:03,301 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:03,302 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 18:12:03,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 18:12:03,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-14 18:12:03,304 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 18:12:03,304 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689358923304 2023-07-14 18:12:03,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,312 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 18:12:03,312 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:03,313 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 18:12:03,313 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 18:12:03,314 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,314 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,314 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,314 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,314 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,314 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,315 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,315 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,316 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 18:12:03,316 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 18:12:03,316 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:03,316 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:03,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,320 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 18:12:03,320 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 18:12:03,320 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:03,320 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 18:12:03,320 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 18:12:03,321 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:03,323 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,322 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:03,323 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 18:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@605bd1f0[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:03,324 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 18:12:03,324 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,325 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 18:12:03,325 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 18:12:03,325 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 18:12:03,325 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:03,326 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:03,326 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:03,326 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:03,326 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. started... 2023-07-14 18:12:03,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,328 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 861078e14400e65f9fe69fdbb6490ceb: 2023-07-14 18:12:03,328 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 18:12:03,328 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 18:12:03,328 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:03,328 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,328 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:03,328 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/0d841567363241f297c0a4588f0a4115.1a6476e69dfc76b2fc6dad991bcef106->hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115-top, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/f523ba42af6e4d6bb5401f16e53e62e2.8270958232f420a433acef4d267ed5a7->hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2-top] hfiles 2023-07-14 18:12:03,328 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/0d841567363241f297c0a4588f0a4115.1a6476e69dfc76b2fc6dad991bcef106 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,328 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,328 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:03,329 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/f523ba42af6e4d6bb5401f16e53e62e2.8270958232f420a433acef4d267ed5a7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,329 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 18:12:03,329 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:03,329 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 18:12:03,331 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 18:12:03,331 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:03,331 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 18:12:03,344 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. completed. 2023-07-14 18:12:03,344 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:03,344 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:03,344 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:03,344 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,344 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 18:12:03,345 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:03,349 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,349 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:03,349 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:03,349 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:03,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:03,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:12:03,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 18:12:03,351 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 18:12:03,351 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:03,351 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:03,352 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,352 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:03,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,355 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,356 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,356 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,363 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:03,364 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,364 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,366 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:03,366 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,367 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:03,368 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:03,368 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,368 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:03,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:03,402 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:03,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 18:12:03,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:03,404 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:03,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 18:12:03,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,457 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689358323297Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689358323366 (+69 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689358323367 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689358323370 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689358323414 (+44 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689358323457 (+43 ms) 2023-07-14 18:12:03,460 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 18:12:03,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 161 msec 2023-07-14 18:12:03,604 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 18:12:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:03,605 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605 2023-07-14 18:12:03,605 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46427, tgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605, rawTgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:03,623 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:03,623 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1364291728_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,623 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 18:12:03,635 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:03,662 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,663 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,664 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,664 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,664 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,665 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,665 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,754 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-7414588097446492324.jar 2023-07-14 18:12:03,755 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,755 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,755 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,756 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,756 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,757 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:03,757 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:12:03,757 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:12:03,758 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:12:03,758 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:12:03,759 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:12:03,759 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:12:03,760 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:12:03,760 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:12:03,760 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:12:03,761 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:12:03,761 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:03,761 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:03,762 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:03,762 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:03,762 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:03,763 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:03,763 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:04,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0004_000001 (auth:SIMPLE) 2023-07-14 18:12:04,600 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:12:04,603 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 18:12:04,605 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 18:12:04,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:04,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:05,102 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0005_000001 (auth:SIMPLE) 2023-07-14 18:12:05,362 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:12:09,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0005_000001 (auth:SIMPLE) 2023-07-14 18:12:12,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0005_000001 (auth:SIMPLE) 2023-07-14 18:12:15,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0005_000001 (auth:SIMPLE) 2023-07-14 18:12:16,856 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:12:16,857 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:12:16,867 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,867 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:12:16,868 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:12:16,868 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,869 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 18:12:16,869 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 18:12:16,869 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,870 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 18:12:16,870 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358323605/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 18:12:16,878 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:16,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 18:12:16,884 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358336884"}]},"ts":"1689358336884"} 2023-07-14 18:12:16,886 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 18:12:16,887 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 18:12:16,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, UNASSIGN}] 2023-07-14 18:12:16,891 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, UNASSIGN 2023-07-14 18:12:16,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=861078e14400e65f9fe69fdbb6490ceb, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:16,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689358336893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358336893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358336893"}]},"ts":"1689358336893"} 2023-07-14 18:12:16,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 861078e14400e65f9fe69fdbb6490ceb, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:16,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 18:12:17,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:17,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 861078e14400e65f9fe69fdbb6490ceb, disabling compactions & flushes 2023-07-14 18:12:17,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:17,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:17,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. after waiting 0 ms 2023-07-14 18:12:17,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:17,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 18:12:17,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:17,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb. 2023-07-14 18:12:17,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 861078e14400e65f9fe69fdbb6490ceb: 2023-07-14 18:12:17,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:17,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=861078e14400e65f9fe69fdbb6490ceb, regionState=CLOSED 2023-07-14 18:12:17,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689358337066"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358337066"}]},"ts":"1689358337066"} 2023-07-14 18:12:17,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 18:12:17,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 861078e14400e65f9fe69fdbb6490ceb, server=jenkins-hbase20.apache.org,38741,1689358246539 in 173 msec 2023-07-14 18:12:17,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 18:12:17,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=861078e14400e65f9fe69fdbb6490ceb, UNASSIGN in 181 msec 2023-07-14 18:12:17,072 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358337072"}]},"ts":"1689358337072"} 2023-07-14 18:12:17,073 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 18:12:17,075 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 18:12:17,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-07-14 18:12:17,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 18:12:17,187 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 18:12:17,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,191 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,192 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,193 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,195 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,196 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,196 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,196 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,196 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 18:12:17,196 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 18:12:17,197 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 18:12:17,197 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,198 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,199 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:17,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 18:12:17,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:17,202 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:17,203 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:17,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:17,203 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:17,203 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:17,205 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/recovered.edits] 2023-07-14 18:12:17,206 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/recovered.edits] 2023-07-14 18:12:17,208 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/recovered.edits] 2023-07-14 18:12:17,214 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/cf/f523ba42af6e4d6bb5401f16e53e62e2 2023-07-14 18:12:17,214 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/cf/0d841567363241f297c0a4588f0a4115 2023-07-14 18:12:17,215 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/0d841567363241f297c0a4588f0a4115.1a6476e69dfc76b2fc6dad991bcef106 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/0d841567363241f297c0a4588f0a4115.1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:17,217 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/f523ba42af6e4d6bb5401f16e53e62e2.8270958232f420a433acef4d267ed5a7 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/cf/f523ba42af6e4d6bb5401f16e53e62e2.8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:17,217 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/recovered.edits/8.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7/recovered.edits/8.seqid 2023-07-14 18:12:17,218 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8270958232f420a433acef4d267ed5a7 2023-07-14 18:12:17,218 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/recovered.edits/8.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106/recovered.edits/8.seqid 2023-07-14 18:12:17,219 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1a6476e69dfc76b2fc6dad991bcef106 2023-07-14 18:12:17,220 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/recovered.edits/12.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb/recovered.edits/12.seqid 2023-07-14 18:12:17,221 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/861078e14400e65f9fe69fdbb6490ceb 2023-07-14 18:12:17,221 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 18:12:17,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,228 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 18:12:17,231 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 18:12:17,232 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,232 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 18:12:17,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358337232"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:17,238 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 18:12:17,238 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 861078e14400e65f9fe69fdbb6490ceb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689358321507.861078e14400e65f9fe69fdbb6490ceb.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 18:12:17,238 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 18:12:17,238 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358337238"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:17,240 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 18:12:17,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 54 msec 2023-07-14 18:12:17,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 18:12:17,301 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 18:12:17,302 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358337321"}]},"ts":"1689358337321"} 2023-07-14 18:12:17,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 18:12:17,328 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 18:12:17,329 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 18:12:17,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, UNASSIGN}] 2023-07-14 18:12:17,336 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, UNASSIGN 2023-07-14 18:12:17,336 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, UNASSIGN 2023-07-14 18:12:17,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b8c8dfc474a9ca17197a4e62c343eb01, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:17,339 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=27fc374f37023ec10626af9c1cb90a7f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:17,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358337338"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358337338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358337338"}]},"ts":"1689358337338"} 2023-07-14 18:12:17,339 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358337338"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358337338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358337338"}]},"ts":"1689358337338"} 2023-07-14 18:12:17,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure b8c8dfc474a9ca17197a4e62c343eb01, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:17,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 27fc374f37023ec10626af9c1cb90a7f, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:17,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 18:12:17,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:17,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 27fc374f37023ec10626af9c1cb90a7f, disabling compactions & flushes 2023-07-14 18:12:17,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:17,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:17,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. after waiting 0 ms 2023-07-14 18:12:17,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:17,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b8c8dfc474a9ca17197a4e62c343eb01, disabling compactions & flushes 2023-07-14 18:12:17,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:17,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. after waiting 0 ms 2023-07-14 18:12:17,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:17,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:17,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:17,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f. 2023-07-14 18:12:17,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 27fc374f37023ec10626af9c1cb90a7f: 2023-07-14 18:12:17,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:17,544 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=27fc374f37023ec10626af9c1cb90a7f, regionState=CLOSED 2023-07-14 18:12:17,544 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358337544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358337544"}]},"ts":"1689358337544"} 2023-07-14 18:12:17,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-14 18:12:17,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 27fc374f37023ec10626af9c1cb90a7f, server=jenkins-hbase20.apache.org,38741,1689358246539 in 204 msec 2023-07-14 18:12:17,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=27fc374f37023ec10626af9c1cb90a7f, UNASSIGN in 218 msec 2023-07-14 18:12:17,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:17,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:17,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01. 2023-07-14 18:12:17,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b8c8dfc474a9ca17197a4e62c343eb01: 2023-07-14 18:12:17,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:17,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b8c8dfc474a9ca17197a4e62c343eb01, regionState=CLOSED 2023-07-14 18:12:17,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689358337559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358337559"}]},"ts":"1689358337559"} 2023-07-14 18:12:17,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-14 18:12:17,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure b8c8dfc474a9ca17197a4e62c343eb01, server=jenkins-hbase20.apache.org,34151,1689358246638 in 219 msec 2023-07-14 18:12:17,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-14 18:12:17,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b8c8dfc474a9ca17197a4e62c343eb01, UNASSIGN in 232 msec 2023-07-14 18:12:17,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358337567"}]},"ts":"1689358337567"} 2023-07-14 18:12:17,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 18:12:17,569 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 18:12:17,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 266 msec 2023-07-14 18:12:17,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 18:12:17,631 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 18:12:17,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,638 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,641 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,643 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,643 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,643 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,643 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 18:12:17,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 18:12:17,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 18:12:17,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 18:12:17,644 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,644 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,644 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,644 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,645 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,645 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,645 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,645 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:17,645 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:17,646 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:17,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 18:12:17,648 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/recovered.edits] 2023-07-14 18:12:17,650 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/recovered.edits] 2023-07-14 18:12:17,658 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/cf/4d92e180599444728108fba35f6efe2e 2023-07-14 18:12:17,659 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/cf/fdbc787e52924034b8131e079f1868ae 2023-07-14 18:12:17,661 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01/recovered.edits/9.seqid 2023-07-14 18:12:17,662 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b8c8dfc474a9ca17197a4e62c343eb01 2023-07-14 18:12:17,664 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f/recovered.edits/9.seqid 2023-07-14 18:12:17,665 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/27fc374f37023ec10626af9c1cb90a7f 2023-07-14 18:12:17,665 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 18:12:17,665 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 18:12:17,666 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-14 18:12:17,669 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307141e70939e27654e27870a0497d9862874 2023-07-14 18:12:17,671 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307145aafb7e8e8f74a2b95982abcf2718541 2023-07-14 18:12:17,671 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 18:12:17,680 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,686 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 18:12:17,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 18:12:17,693 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,694 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 18:12:17,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358337694"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:17,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358337694"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:17,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:12:17,697 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 27fc374f37023ec10626af9c1cb90a7f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689358320087.27fc374f37023ec10626af9c1cb90a7f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b8c8dfc474a9ca17197a4e62c343eb01, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689358320087.b8c8dfc474a9ca17197a4e62c343eb01.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:12:17,697 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 18:12:17,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358337697"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:17,699 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 18:12:17,701 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 69 msec 2023-07-14 18:12:17,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 18:12:17,748 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 18:12:17,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 18:12:17,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 18:12:17,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 18:12:17,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 18:12:17,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 18:12:17,807 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 745) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:42253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4108 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:38926 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1400219883_1 at /127.0.0.1:42262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:42294 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1400219883_1 at /127.0.0.1:38894 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:48996 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 903), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=411 (was 344) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=1937 (was 2520) 2023-07-14 18:12:17,807 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 18:12:17,829 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=411, ProcessCount=175, AvailableMemoryMB=1934 2023-07-14 18:12:17,829 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 18:12:17,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:12:17,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:17,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:12:17,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 18:12:17,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 18:12:17,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:12:17,842 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:17,842 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:17,842 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 empty. 2023-07-14 18:12:17,843 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b empty. 2023-07-14 18:12:17,843 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:17,843 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:17,843 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 18:12:17,889 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 18:12:17,891 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87017a13f076cdb3c4299cfdecd01c2b, NAME => 'testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:17,893 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a62a7de834c7a0cc76ad8ec70a655227, NAME => 'testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 87017a13f076cdb3c4299cfdecd01c2b, disabling compactions & flushes 2023-07-14 18:12:17,914 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. after waiting 0 ms 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:17,914 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:17,914 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 87017a13f076cdb3c4299cfdecd01c2b: 2023-07-14 18:12:17,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 18:12:18,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 18:12:18,315 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:18,316 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a62a7de834c7a0cc76ad8ec70a655227, disabling compactions & flushes 2023-07-14 18:12:18,316 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,316 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,316 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. after waiting 0 ms 2023-07-14 18:12:18,316 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,316 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,316 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a62a7de834c7a0cc76ad8ec70a655227: 2023-07-14 18:12:18,326 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:12:18,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358338327"}]},"ts":"1689358338327"} 2023-07-14 18:12:18,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358338327"}]},"ts":"1689358338327"} 2023-07-14 18:12:18,330 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:12:18,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:12:18,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358338331"}]},"ts":"1689358338331"} 2023-07-14 18:12:18,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 18:12:18,334 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:12:18,335 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:12:18,335 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:12:18,335 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:12:18,335 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:12:18,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, ASSIGN}] 2023-07-14 18:12:18,339 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, ASSIGN 2023-07-14 18:12:18,339 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, ASSIGN 2023-07-14 18:12:18,340 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34151,1689358246638; forceNewPlan=false, retain=false 2023-07-14 18:12:18,340 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:12:18,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 18:12:18,490 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:12:18,494 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=87017a13f076cdb3c4299cfdecd01c2b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:18,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a62a7de834c7a0cc76ad8ec70a655227, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:18,494 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338494"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358338494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358338494"}]},"ts":"1689358338494"} 2023-07-14 18:12:18,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338494"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358338494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358338494"}]},"ts":"1689358338494"} 2023-07-14 18:12:18,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure a62a7de834c7a0cc76ad8ec70a655227, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:12:18,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 87017a13f076cdb3c4299cfdecd01c2b, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:18,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87017a13f076cdb3c4299cfdecd01c2b, NAME => 'testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:12:18,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. service=AccessControlService 2023-07-14 18:12:18,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:18,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:18,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,664 INFO [StoreOpener-87017a13f076cdb3c4299cfdecd01c2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a62a7de834c7a0cc76ad8ec70a655227, NAME => 'testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. service=AccessControlService 2023-07-14 18:12:18,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,668 DEBUG [StoreOpener-87017a13f076cdb3c4299cfdecd01c2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf 2023-07-14 18:12:18,668 DEBUG [StoreOpener-87017a13f076cdb3c4299cfdecd01c2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf 2023-07-14 18:12:18,668 INFO [StoreOpener-a62a7de834c7a0cc76ad8ec70a655227-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,668 INFO [StoreOpener-87017a13f076cdb3c4299cfdecd01c2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87017a13f076cdb3c4299cfdecd01c2b columnFamilyName cf 2023-07-14 18:12:18,669 DEBUG [StoreOpener-a62a7de834c7a0cc76ad8ec70a655227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf 2023-07-14 18:12:18,669 DEBUG [StoreOpener-a62a7de834c7a0cc76ad8ec70a655227-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf 2023-07-14 18:12:18,669 INFO [StoreOpener-87017a13f076cdb3c4299cfdecd01c2b-1] regionserver.HStore(310): Store=87017a13f076cdb3c4299cfdecd01c2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:18,670 INFO [StoreOpener-a62a7de834c7a0cc76ad8ec70a655227-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a62a7de834c7a0cc76ad8ec70a655227 columnFamilyName cf 2023-07-14 18:12:18,670 INFO [StoreOpener-a62a7de834c7a0cc76ad8ec70a655227-1] regionserver.HStore(310): Store=a62a7de834c7a0cc76ad8ec70a655227/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:18,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:18,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:18,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a62a7de834c7a0cc76ad8ec70a655227; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63064615, jitterRate=-0.06026400625705719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a62a7de834c7a0cc76ad8ec70a655227: 2023-07-14 18:12:18,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227., pid=93, masterSystemTime=1689358338653 2023-07-14 18:12:18,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:18,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a62a7de834c7a0cc76ad8ec70a655227, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:18,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338681"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358338681"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358338681"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358338681"}]},"ts":"1689358338681"} 2023-07-14 18:12:18,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 18:12:18,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure a62a7de834c7a0cc76ad8ec70a655227, server=jenkins-hbase20.apache.org,34403,1689358246599 in 185 msec 2023-07-14 18:12:18,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, ASSIGN in 350 msec 2023-07-14 18:12:18,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:18,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 87017a13f076cdb3c4299cfdecd01c2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75481887, jitterRate=0.12476776540279388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:18,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 87017a13f076cdb3c4299cfdecd01c2b: 2023-07-14 18:12:18,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b., pid=94, masterSystemTime=1689358338653 2023-07-14 18:12:18,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:18,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:18,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=87017a13f076cdb3c4299cfdecd01c2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:18,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358338699"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358338699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358338699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358338699"}]},"ts":"1689358338699"} 2023-07-14 18:12:18,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 18:12:18,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 87017a13f076cdb3c4299cfdecd01c2b, server=jenkins-hbase20.apache.org,34151,1689358246638 in 203 msec 2023-07-14 18:12:18,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-14 18:12:18,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, ASSIGN in 367 msec 2023-07-14 18:12:18,708 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:12:18,708 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358338708"}]},"ts":"1689358338708"} 2023-07-14 18:12:18,710 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 18:12:18,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:12:18,712 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 18:12:18,715 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:12:18,716 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:18,717 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:18,716 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:18,717 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:18,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:18,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:18,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:18,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:18,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 887 msec 2023-07-14 18:12:18,890 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 18:12:18,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 18:12:18,952 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 18:12:18,957 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:18,957 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:18,963 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:18,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:18,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358338992 (current time:1689358338992). 2023-07-14 18:12:18,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:18,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x2d0d6e67 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:19,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b4545bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:19,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,020 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d0d6e67 to 127.0.0.1:57638 2023-07-14 18:12:19,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:19,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x0f11213d to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:19,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49a908ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:19,042 DEBUG [hconnection-0x800d4cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,043 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,055 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f11213d to 127.0.0.1:57638 2023-07-14 18:12:19,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:19,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:12:19,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:19,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:19,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,063 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,064 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689358939064 2023-07-14 18:12:19,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:19,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:19,067 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:19,069 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:19,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:19,069 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-14 18:12:19,075 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:19,076 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689358939076 2023-07-14 18:12:19,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,132 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 18:12:19,132 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,133 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 18:12:19,133 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 18:12:19,135 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,135 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,138 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,138 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,138 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,139 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,139 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,139 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 18:12:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,140 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 18:12:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,143 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,143 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,148 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,148 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,148 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,148 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,148 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,149 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,149 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 18:12:19,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,149 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,150 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,150 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,150 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,152 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,152 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,152 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,163 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,163 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,164 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 18:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aa072e0[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 18:12:19,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aa072e0[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:19,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 18:12:19,169 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,169 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:19,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:19,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:19,171 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:19,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,179 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,180 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,179 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:19,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,180 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:19,180 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,180 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,180 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,180 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:19,186 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:19,186 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:19,187 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:19,187 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:19,186 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:19,187 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. started... 2023-07-14 18:12:19,187 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:19,187 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. started... 2023-07-14 18:12:19,187 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87017a13f076cdb3c4299cfdecd01c2b: 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a62a7de834c7a0cc76ad8ec70a655227: 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:19,189 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:19,193 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:19,194 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:19,194 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:19,225 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. completed. 2023-07-14 18:12:19,225 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:19,225 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:19,225 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:19,225 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,225 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:19,225 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:19,226 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:19,226 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,226 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,226 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:19,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,232 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. completed. 2023-07-14 18:12:19,232 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,232 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:19,232 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:19,232 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,232 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:19,232 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:19,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,243 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,244 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:19,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,244 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:19,244 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:12:19,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 18:12:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:12:19,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 18:12:19,253 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 18:12:19,253 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:19,253 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:19,253 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,253 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,255 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,254 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,255 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,255 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,259 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,259 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,260 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:19,270 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,269 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:19,270 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:19,270 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,272 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:19,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:12:19,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:19,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,371 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:19,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:19,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:19,373 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 18:12:19,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 18:12:19,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,415 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689358339065Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689358339293 (+228 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689358339293Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689358339293Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689358339324 (+31 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689358339369 (+45 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689358339414 (+45 ms) 2023-07-14 18:12:19,419 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:19,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 353 msec 2023-07-14 18:12:19,673 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:19,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:19,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:19,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:19,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34151] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:19,688 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:19,688 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:19,688 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:19,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:19,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358339699 (current time:1689358339699). 2023-07-14 18:12:19,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:19,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6d9aae86 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:19,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63328972, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:19,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,731 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d9aae86 to 127.0.0.1:57638 2023-07-14 18:12:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:19,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x1339e06d to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:19,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b6f9212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:19,754 DEBUG [hconnection-0x5ce1e714-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,758 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:19,767 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1339e06d to 127.0.0.1:57638 2023-07-14 18:12:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:19,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 18:12:19,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:19,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:19,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,777 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,778 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689358939778 2023-07-14 18:12:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 18:12:19,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:19,780 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:19,780 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:19,781 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 18:12:19,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:19,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-14 18:12:19,785 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:19,791 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689358939791 2023-07-14 18:12:19,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,803 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 18:12:19,803 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,805 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 18:12:19,805 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 18:12:19,805 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,806 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,807 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,807 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,807 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:19,807 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,807 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,808 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,809 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:19,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 18:12:19,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,809 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,809 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,811 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 18:12:19,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,812 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,812 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 18:12:19,812 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,812 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:19,813 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 18:12:19,818 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,818 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,819 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,819 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,827 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,829 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,829 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,829 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,829 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,830 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,830 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18dc34d9[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:19,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:19,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:19,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 18:12:19,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18dc34d9[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:19,837 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 18:12:19,837 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,837 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,839 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,839 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,839 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,840 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,840 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,840 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 18:12:19,840 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:19,840 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:19,840 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:19,840 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:19,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:19,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:19,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:19,841 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:19,852 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:19,852 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:19,851 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:19,852 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. started... 2023-07-14 18:12:19,852 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87017a13f076cdb3c4299cfdecd01c2b 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 18:12:19,851 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:19,852 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:19,852 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. started... 2023-07-14 18:12:19,853 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a62a7de834c7a0cc76ad8ec70a655227 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 18:12:19,880 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:19,884 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:19,918 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b 2023-07-14 18:12:19,940 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227 2023-07-14 18:12:19,947 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/.tmp/cf/6f5a786a39254b75ae802cd1d6c6772a 2023-07-14 18:12:19,953 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/.tmp/cf/6f5a786a39254b75ae802cd1d6c6772a as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a 2023-07-14 18:12:19,959 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a, entries=3, sequenceid=6, filesize=5.4 K 2023-07-14 18:12:19,960 INFO [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 87017a13f076cdb3c4299cfdecd01c2b in 107ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:19,973 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87017a13f076cdb3c4299cfdecd01c2b: 2023-07-14 18:12:19,973 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:19,973 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:19,973 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a] hfiles 2023-07-14 18:12:19,973 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,007 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/.tmp/cf/5270ff25642b40609541ba175c1913ae 2023-07-14 18:12:20,014 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/.tmp/cf/5270ff25642b40609541ba175c1913ae as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae 2023-07-14 18:12:20,022 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae, entries=47, sequenceid=6, filesize=13.1 K 2023-07-14 18:12:20,023 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a62a7de834c7a0cc76ad8ec70a655227 in 170ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:20,023 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a62a7de834c7a0cc76ad8ec70a655227: 2023-07-14 18:12:20,023 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,023 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:20,023 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae] hfiles 2023-07-14 18:12:20,023 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,033 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. completed. 2023-07-14 18:12:20,033 DEBUG [rs(jenkins-hbase20.apache.org,34151,1689358246638)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:20,034 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:20,034 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:20,035 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:20,036 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34151,1689358246638': 2023-07-14 18:12:20,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 18:12:20,049 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. completed. 2023-07-14 18:12:20,049 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:20,049 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:20,049 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:20,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 18:12:20,050 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:20,051 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,051 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 18:12:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:20,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:20,051 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:20,051 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 18:12:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:20,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:12:20,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 18:12:20,058 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 18:12:20,058 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:20,058 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:20,058 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,058 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:20,059 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:20,059 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:20,059 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,060 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,061 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:20,061 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:20,063 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,064 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,064 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:20,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:20,071 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:20,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:20,071 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:20,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:20,072 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:20,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b] mob files 2023-07-14 18:12:20,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227 2023-07-14 18:12:20,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b 2023-07-14 18:12:20,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,075 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:20,075 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:20,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:20,084 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:20,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:20,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:20,086 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 18:12:20,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 18:12:20,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689358339778Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689358340095 (+317 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689358340095Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689358340096 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689358340100 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689358340112 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689358340179 (+67 ms) 2023-07-14 18:12:20,184 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 18:12:20,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 405 msec 2023-07-14 18:12:20,386 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:20,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 18:12:20,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:20,388 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387 2023-07-14 18:12:20,388 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46427, tgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387, rawTgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:20,417 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:20,417 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127091553_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,418 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 18:12:20,438 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:20,492 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,492 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,493 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,493 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,493 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,494 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,494 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,566 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-2469874793554150264.jar 2023-07-14 18:12:20,567 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,567 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,568 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,568 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,569 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,569 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:20,569 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:12:20,569 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:12:20,570 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:12:20,570 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:12:20,570 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:12:20,571 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:12:20,571 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:12:20,572 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:12:20,572 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:12:20,573 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:12:20,573 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:20,574 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:20,574 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:20,575 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:20,575 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:20,576 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:20,576 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:21,439 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0005_000001 (auth:SIMPLE) 2023-07-14 18:12:21,962 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:12:21,965 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 18:12:22,153 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:22,153 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:22,393 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0006_000001 (auth:SIMPLE) 2023-07-14 18:12:22,692 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:12:27,193 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0006_000001 (auth:SIMPLE) 2023-07-14 18:12:30,276 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:12:30,277 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:12:30,294 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:30,295 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:12:30,297 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:12:30,297 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:30,298 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 18:12:30,299 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 18:12:30,299 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:30,299 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 18:12:30,299 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358340387/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 18:12:30,322 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358350331"}]},"ts":"1689358350331"} 2023-07-14 18:12:30,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 18:12:30,332 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 18:12:30,333 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 18:12:30,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, UNASSIGN}] 2023-07-14 18:12:30,340 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, UNASSIGN 2023-07-14 18:12:30,340 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, UNASSIGN 2023-07-14 18:12:30,341 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=87017a13f076cdb3c4299cfdecd01c2b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:30,341 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a62a7de834c7a0cc76ad8ec70a655227, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:30,341 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358350341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358350341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358350341"}]},"ts":"1689358350341"} 2023-07-14 18:12:30,341 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358350341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358350341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358350341"}]},"ts":"1689358350341"} 2023-07-14 18:12:30,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 87017a13f076cdb3c4299cfdecd01c2b, server=jenkins-hbase20.apache.org,34151,1689358246638}] 2023-07-14 18:12:30,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure a62a7de834c7a0cc76ad8ec70a655227, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:12:30,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 18:12:30,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:30,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a62a7de834c7a0cc76ad8ec70a655227, disabling compactions & flushes 2023-07-14 18:12:30,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:30,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:30,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. after waiting 0 ms 2023-07-14 18:12:30,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:30,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:30,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 87017a13f076cdb3c4299cfdecd01c2b, disabling compactions & flushes 2023-07-14 18:12:30,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:30,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:30,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. after waiting 0 ms 2023-07-14 18:12:30,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:30,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:30,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227. 2023-07-14 18:12:30,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a62a7de834c7a0cc76ad8ec70a655227: 2023-07-14 18:12:30,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:30,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:30,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:30,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a62a7de834c7a0cc76ad8ec70a655227, regionState=CLOSED 2023-07-14 18:12:30,554 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358350554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358350554"}]},"ts":"1689358350554"} 2023-07-14 18:12:30,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b. 2023-07-14 18:12:30,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 87017a13f076cdb3c4299cfdecd01c2b: 2023-07-14 18:12:30,560 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=87017a13f076cdb3c4299cfdecd01c2b, regionState=CLOSED 2023-07-14 18:12:30,560 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689358350560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358350560"}]},"ts":"1689358350560"} 2023-07-14 18:12:30,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:30,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 18:12:30,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure a62a7de834c7a0cc76ad8ec70a655227, server=jenkins-hbase20.apache.org,34403,1689358246599 in 211 msec 2023-07-14 18:12:30,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a62a7de834c7a0cc76ad8ec70a655227, UNASSIGN in 227 msec 2023-07-14 18:12:30,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 18:12:30,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 87017a13f076cdb3c4299cfdecd01c2b, server=jenkins-hbase20.apache.org,34151,1689358246638 in 220 msec 2023-07-14 18:12:30,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-14 18:12:30,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=87017a13f076cdb3c4299cfdecd01c2b, UNASSIGN in 230 msec 2023-07-14 18:12:30,568 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358350568"}]},"ts":"1689358350568"} 2023-07-14 18:12:30,570 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 18:12:30,571 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 18:12:30,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 249 msec 2023-07-14 18:12:30,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 18:12:30,648 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 18:12:30,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,655 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,656 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,658 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,658 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,658 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,658 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 18:12:30,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 18:12:30,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 18:12:30,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,660 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:30,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 18:12:30,662 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:30,662 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:30,664 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/recovered.edits] 2023-07-14 18:12:30,664 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/recovered.edits] 2023-07-14 18:12:30,674 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/cf/6f5a786a39254b75ae802cd1d6c6772a 2023-07-14 18:12:30,675 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/cf/5270ff25642b40609541ba175c1913ae 2023-07-14 18:12:30,678 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b/recovered.edits/9.seqid 2023-07-14 18:12:30,679 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227/recovered.edits/9.seqid 2023-07-14 18:12:30,679 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/a62a7de834c7a0cc76ad8ec70a655227 2023-07-14 18:12:30,680 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testEmptyExportFileSystemState/87017a13f076cdb3c4299cfdecd01c2b 2023-07-14 18:12:30,680 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 18:12:30,681 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 18:12:30,682 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-14 18:12:30,687 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307141128cdda1b3c45458376e9211c9c5227 2023-07-14 18:12:30,691 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714d809b79ee4d240beb06bf9d202d5924b 2023-07-14 18:12:30,691 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 18:12:30,694 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,696 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 18:12:30,709 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 18:12:30,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 18:12:30,711 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358350711"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:30,711 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358350711"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:30,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:12:30,717 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87017a13f076cdb3c4299cfdecd01c2b, NAME => 'testtb-testEmptyExportFileSystemState,,1689358337831.87017a13f076cdb3c4299cfdecd01c2b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a62a7de834c7a0cc76ad8ec70a655227, NAME => 'testtb-testEmptyExportFileSystemState,1,1689358337831.a62a7de834c7a0cc76ad8ec70a655227.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:12:30,717 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 18:12:30,717 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358350717"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:30,720 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 18:12:30,722 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 18:12:30,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 71 msec 2023-07-14 18:12:30,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 18:12:30,763 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 18:12:30,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 18:12:30,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:30,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 18:12:30,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 18:12:30,806 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 757) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:33005 from appattempt_1689358255347_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:47660 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_634593772_1 at /127.0.0.1:38792 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:34097 from appattempt_1689358255347_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1555247416) connection to jenkins-hbase20.apache.org/148.251.75.209:46513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:51750 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4790 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2f3addaa-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2061060552_17 at /127.0.0.1:53870 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=407 (was 411), ProcessCount=175 (was 175), AvailableMemoryMB=1761 (was 1934) 2023-07-14 18:12:30,806 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 18:12:30,834 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=407, ProcessCount=175, AvailableMemoryMB=1760 2023-07-14 18:12:30,834 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 18:12:30,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 18:12:30,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:30,840 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 18:12:30,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 18:12:30,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 18:12:30,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 18:12:30,843 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:30,843 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:30,844 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 empty. 2023-07-14 18:12:30,844 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 empty. 2023-07-14 18:12:30,845 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:30,845 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:30,845 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 18:12:30,871 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 18:12:30,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c79656b172372990d8fe11e027c7a5d5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:30,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b9fc8554bfc97fd48b1403d3cd25e20, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp 2023-07-14 18:12:30,900 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:30,900 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c79656b172372990d8fe11e027c7a5d5, disabling compactions & flushes 2023-07-14 18:12:30,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. after waiting 0 ms 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 5b9fc8554bfc97fd48b1403d3cd25e20, disabling compactions & flushes 2023-07-14 18:12:30,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:30,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c79656b172372990d8fe11e027c7a5d5: 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. after waiting 0 ms 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:30,901 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:30,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 5b9fc8554bfc97fd48b1403d3cd25e20: 2023-07-14 18:12:30,903 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 18:12:30,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358350904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358350904"}]},"ts":"1689358350904"} 2023-07-14 18:12:30,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358350904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358350904"}]},"ts":"1689358350904"} 2023-07-14 18:12:30,906 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 18:12:30,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 18:12:30,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358350907"}]},"ts":"1689358350907"} 2023-07-14 18:12:30,908 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 18:12:30,910 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-14 18:12:30,911 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 18:12:30,911 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 18:12:30,911 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 18:12:30,911 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 18:12:30,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, ASSIGN}] 2023-07-14 18:12:30,914 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, ASSIGN 2023-07-14 18:12:30,914 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, ASSIGN 2023-07-14 18:12:30,915 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34403,1689358246599; forceNewPlan=false, retain=false 2023-07-14 18:12:30,915 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38741,1689358246539; forceNewPlan=false, retain=false 2023-07-14 18:12:30,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 18:12:31,065 INFO [jenkins-hbase20:44973] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 18:12:31,069 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5b9fc8554bfc97fd48b1403d3cd25e20, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,069 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c79656b172372990d8fe11e027c7a5d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,069 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358351069"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358351069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358351069"}]},"ts":"1689358351069"} 2023-07-14 18:12:31,069 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358351069"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358351069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358351069"}]},"ts":"1689358351069"} 2023-07-14 18:12:31,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 5b9fc8554bfc97fd48b1403d3cd25e20, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:31,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure c79656b172372990d8fe11e027c7a5d5, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:12:31,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 18:12:31,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c79656b172372990d8fe11e027c7a5d5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 18:12:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. service=AccessControlService 2023-07-14 18:12:31,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b9fc8554bfc97fd48b1403d3cd25e20, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. service=AccessControlService 2023-07-14 18:12:31,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,232 INFO [StoreOpener-c79656b172372990d8fe11e027c7a5d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,233 INFO [StoreOpener-5b9fc8554bfc97fd48b1403d3cd25e20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,233 DEBUG [StoreOpener-c79656b172372990d8fe11e027c7a5d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf 2023-07-14 18:12:31,233 DEBUG [StoreOpener-c79656b172372990d8fe11e027c7a5d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf 2023-07-14 18:12:31,234 INFO [StoreOpener-c79656b172372990d8fe11e027c7a5d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c79656b172372990d8fe11e027c7a5d5 columnFamilyName cf 2023-07-14 18:12:31,234 DEBUG [StoreOpener-5b9fc8554bfc97fd48b1403d3cd25e20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf 2023-07-14 18:12:31,234 DEBUG [StoreOpener-5b9fc8554bfc97fd48b1403d3cd25e20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf 2023-07-14 18:12:31,235 INFO [StoreOpener-5b9fc8554bfc97fd48b1403d3cd25e20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b9fc8554bfc97fd48b1403d3cd25e20 columnFamilyName cf 2023-07-14 18:12:31,235 INFO [StoreOpener-c79656b172372990d8fe11e027c7a5d5-1] regionserver.HStore(310): Store=c79656b172372990d8fe11e027c7a5d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:31,236 INFO [StoreOpener-5b9fc8554bfc97fd48b1403d3cd25e20-1] regionserver.HStore(310): Store=5b9fc8554bfc97fd48b1403d3cd25e20/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 18:12:31,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:31,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:31,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:31,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c79656b172372990d8fe11e027c7a5d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68081014, jitterRate=0.014486163854598999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:31,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c79656b172372990d8fe11e027c7a5d5: 2023-07-14 18:12:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 18:12:31,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5., pid=109, masterSystemTime=1689358351223 2023-07-14 18:12:31,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5b9fc8554bfc97fd48b1403d3cd25e20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63321344, jitterRate=-0.056438446044921875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 18:12:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5b9fc8554bfc97fd48b1403d3cd25e20: 2023-07-14 18:12:31,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20., pid=108, masterSystemTime=1689358351223 2023-07-14 18:12:31,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:31,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:31,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c79656b172372990d8fe11e027c7a5d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358351244"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358351244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358351244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358351244"}]},"ts":"1689358351244"} 2023-07-14 18:12:31,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5b9fc8554bfc97fd48b1403d3cd25e20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358351245"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689358351245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689358351245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689358351245"}]},"ts":"1689358351245"} 2023-07-14 18:12:31,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 18:12:31,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure c79656b172372990d8fe11e027c7a5d5, server=jenkins-hbase20.apache.org,34403,1689358246599 in 174 msec 2023-07-14 18:12:31,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 18:12:31,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 5b9fc8554bfc97fd48b1403d3cd25e20, server=jenkins-hbase20.apache.org,38741,1689358246539 in 176 msec 2023-07-14 18:12:31,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, ASSIGN in 335 msec 2023-07-14 18:12:31,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 18:12:31,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, ASSIGN in 336 msec 2023-07-14 18:12:31,250 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 18:12:31,250 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358351250"}]},"ts":"1689358351250"} 2023-07-14 18:12:31,251 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 18:12:31,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 18:12:31,253 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 18:12:31,254 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 18:12:31,255 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:31,255 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:31,255 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:31,255 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:31,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:31,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:31,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:31,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 18:12:31,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 420 msec 2023-07-14 18:12:31,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 18:12:31,446 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 18:12:31,448 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,449 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,450 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:31,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358351464 (current time:1689358351464). 2023-07-14 18:12:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x1c2ca654 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:31,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@af51db9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:31,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:31,476 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c2ca654 to 127.0.0.1:57638 2023-07-14 18:12:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x6cb28572 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:31,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15d580b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:31,489 DEBUG [hconnection-0x376f5f60-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:31,492 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:31,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:31,501 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:31,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cb28572 to 127.0.0.1:57638 2023-07-14 18:12:31,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:31,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 18:12:31,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:31,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:31,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:31,506 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:31,512 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689358951512 2023-07-14 18:12:31,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:31,514 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:31,514 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:31,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:31,516 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:31,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-14 18:12:31,518 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:31,518 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689358951518 2023-07-14 18:12:31,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,526 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 18:12:31,527 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:31,528 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 18:12:31,528 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 18:12:31,528 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,528 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,532 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:31,532 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,532 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:31,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,532 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,532 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,535 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,536 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:31,536 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:31,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:31,539 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:31,539 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:31,537 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:31,540 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:31,540 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:31,539 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:31,540 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:31,541 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:31,554 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,554 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:31,554 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,554 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:31,554 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,555 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,556 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,556 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:31,556 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,556 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:31,556 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6aa64beb[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:31,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 18:12:31,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6aa64beb[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:31,559 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 18:12:31,559 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:31,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:31,560 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:31,560 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:31,560 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:31,561 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. started... 2023-07-14 18:12:31,561 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:31,561 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:31,561 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c79656b172372990d8fe11e027c7a5d5: 2023-07-14 18:12:31,562 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,562 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. started... 2023-07-14 18:12:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:31,563 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:31,563 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b9fc8554bfc97fd48b1403d3cd25e20: 2023-07-14 18:12:31,563 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:31,563 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:31,563 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 18:12:31,571 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:31,572 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:31,572 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:31,614 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:31,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:31,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:31,616 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:31,816 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:31,817 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 18:12:31,999 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. completed. 2023-07-14 18:12:31,999 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. completed. 2023-07-14 18:12:31,999 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:31,999 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:32,001 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:32,001 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,001 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,001 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,003 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,003 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:32,003 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,003 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:12:32,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 18:12:32,010 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 18:12:32,010 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:32,010 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:32,010 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,010 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,020 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,021 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,021 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,022 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,023 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,023 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,023 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,028 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,029 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,029 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,031 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 18:12:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,117 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:32,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:32,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:32,118 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 18:12:32,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 18:12:32,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,154 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689358351512Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689358352081 (+569 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689358352081Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689358352081Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689358352100 (+19 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689358352127 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689358352153 (+26 ms) 2023-07-14 18:12:32,157 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:32,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 643 msec 2023-07-14 18:12:32,619 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:32,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38741] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:32,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 18:12:32,627 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,627 DEBUG [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:32,627 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 18:12:32,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:32,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689358352637 (current time:1689358352637). 2023-07-14 18:12:32,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 18:12:32,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x71710a52 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:32,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ca8df43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:32,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:32,650 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71710a52 to 127.0.0.1:57638 2023-07-14 18:12:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(139): Connect 0x48ee3898 to 127.0.0.1:57638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 18:12:32,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b4984d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 18:12:32,664 DEBUG [hconnection-0x4b1c1bff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:32,665 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:32,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 18:12:32,678 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 18:12:32,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ee3898 to 127.0.0.1:57638 2023-07-14 18:12:32,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:12:32,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 18:12:32,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 18:12:32,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:32,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:32,684 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:32,685 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689358952685 2023-07-14 18:12:32,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 18:12:32,687 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 18:12:32,687 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 18:12:32,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:32,689 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 18:12:32,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-14 18:12:32,691 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:32,692 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689358952692 2023-07-14 18:12:32,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,707 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 18:12:32,707 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:32,708 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 18:12:32,708 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 18:12:32,709 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,709 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,710 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,710 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,710 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,711 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:32,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:32,711 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 18:12:32,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:32,713 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34151,1689358246638' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 18:12:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 18:12:32,715 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 18:12:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 18:12:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 18:12:32,726 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,729 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,729 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,729 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,730 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 18:12:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38741,1689358246539' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 18:12:32,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@544cd31e[Count = 1] remaining members to acquire global barrier 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34403,1689358246599' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 18:12:32,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@544cd31e[Count = 0] remaining members to acquire global barrier 2023-07-14 18:12:32,733 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 18:12:32,733 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:32,737 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:32,738 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,738 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 18:12:32,738 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34151,1689358246638' in zk 2023-07-14 18:12:32,738 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 18:12:32,738 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:32,738 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. started... 2023-07-14 18:12:32,738 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:32,738 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 18:12:32,738 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. started... 2023-07-14 18:12:32,738 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b9fc8554bfc97fd48b1403d3cd25e20 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 18:12:32,738 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c79656b172372990d8fe11e027c7a5d5 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 18:12:32,739 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:32,739 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,739 DEBUG [member: 'jenkins-hbase20.apache.org,34151,1689358246638' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:32,787 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:32,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:32,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 18:12:32,788 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142 2023-07-14 18:12:32,788 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 18:12:32,790 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046 2023-07-14 18:12:32,803 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/.tmp/cf/a3e43f6565004a16b3bc10126568ff15 2023-07-14 18:12:32,808 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/.tmp/cf/ded06c72870840ab9e1ff6a90f2a0b47 2023-07-14 18:12:32,809 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/.tmp/cf/a3e43f6565004a16b3bc10126568ff15 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15 2023-07-14 18:12:32,813 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/.tmp/cf/ded06c72870840ab9e1ff6a90f2a0b47 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47 2023-07-14 18:12:32,814 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15, entries=45, sequenceid=6, filesize=13.0 K 2023-07-14 18:12:32,814 INFO [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c79656b172372990d8fe11e027c7a5d5 in 76ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:32,815 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 18:12:32,815 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c79656b172372990d8fe11e027c7a5d5: 2023-07-14 18:12:32,815 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,815 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:32,816 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15] hfiles 2023-07-14 18:12:32,816 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,817 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47, entries=5, sequenceid=6, filesize=5.8 K 2023-07-14 18:12:32,822 INFO [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5b9fc8554bfc97fd48b1403d3cd25e20 in 84ms, sequenceid=6, compaction requested=false 2023-07-14 18:12:32,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b9fc8554bfc97fd48b1403d3cd25e20: 2023-07-14 18:12:32,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 18:12:32,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47] hfiles 2023-07-14 18:12:32,824 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,833 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. completed. 2023-07-14 18:12:32,833 DEBUG [rs(jenkins-hbase20.apache.org,34403,1689358246599)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:32,833 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:32,833 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:32,833 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,833 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:32,833 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,34403,1689358246599' in zk 2023-07-14 18:12:32,835 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,835 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,835 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,835 DEBUG [member: 'jenkins-hbase20.apache.org,34403,1689358246599' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:32,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,34403,1689358246599': 2023-07-14 18:12:32,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34403,1689358246599' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 18:12:32,840 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. completed. 2023-07-14 18:12:32,840 DEBUG [rs(jenkins-hbase20.apache.org,38741,1689358246539)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:32,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 18:12:32,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 18:12:32,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 18:12:32,841 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38741,1689358246539' in zk 2023-07-14 18:12:32,843 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,843 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 18:12:32,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,843 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,843 DEBUG [member: 'jenkins-hbase20.apache.org,38741,1689358246539' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 18:12:32,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,38741,1689358246539': 2023-07-14 18:12:32,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38741,1689358246539' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 18:12:32,849 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 18:12:32,849 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 18:12:32,849 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 18:12:32,849 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,849 INFO [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 18:12:32,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,854 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 18:12:32,854 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,856 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 18:12:32,856 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 18:12:32,858 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,858 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,858 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 18:12:32,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,863 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,862 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 18:12:32,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,863 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:32,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 18:12:32,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 18:12:32,863 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:32,863 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,863 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,863 DEBUG [(jenkins-hbase20.apache.org,44973,1689358245251)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 18:12:32,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 18:12:32,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046] mob files 2023-07-14 18:12:32,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142 2023-07-14 18:12:32,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046 2023-07-14 18:12:32,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 18:12:32,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:32,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689358352685Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689358352881 (+196 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689358352881Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689358352881Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689358352889 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689358352920 (+31 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689358352966 (+46 ms) 2023-07-14 18:12:32,969 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 18:12:32,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 282 msec 2023-07-14 18:12:32,989 DEBUG [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 18:12:32,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 18:12:32,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 18:12:32,990 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990 2023-07-14 18:12:32,990 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46427, tgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990, rawTgtDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990, srcFsUri=hdfs://localhost.localdomain:46427, srcDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:33,010 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21 2023-07-14 18:12:33,010 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_330623406_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:33,010 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46427, inputRoot=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21, snapshotDir=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 18:12:33,019 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:33,067 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,068 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,069 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,069 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,070 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,070 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,071 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,155 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/hadoop-4475884694965225422.jar 2023-07-14 18:12:33,156 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,157 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,157 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,158 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,158 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,159 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 18:12:33,159 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 18:12:33,160 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 18:12:33,160 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 18:12:33,161 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 18:12:33,161 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 18:12:33,162 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 18:12:33,162 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 18:12:33,163 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 18:12:33,163 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 18:12:33,164 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 18:12:33,164 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:33,165 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:33,165 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:33,166 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:33,166 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 18:12:33,166 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:33,167 DEBUG [Listener at jenkins-hbase20.apache.org/37587] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 18:12:33,993 WARN [Listener at jenkins-hbase20.apache.org/37587] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 18:12:33,995 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 18:12:33,997 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-14 18:12:34,613 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:34,615 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 18:12:34,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0006_000001 (auth:SIMPLE) 2023-07-14 18:12:35,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0007_000001 (auth:SIMPLE) 2023-07-14 18:12:36,162 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:12:40,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0007_000001 (auth:SIMPLE) 2023-07-14 18:12:43,279 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0007_000001 (auth:SIMPLE) 2023-07-14 18:12:48,257 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 18:12:48,258 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 18:12:48,280 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,280 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 18:12:48,281 INFO [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 18:12:48,281 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,281 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 18:12:48,282 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 18:12:48,282 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2061060552_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,282 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 18:12:48,282 DEBUG [Listener at jenkins-hbase20.apache.org/37587] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/export-test/export-1689358352990/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 18:12:48,291 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358368296"}]},"ts":"1689358368296"} 2023-07-14 18:12:48,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 18:12:48,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 18:12:48,300 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 18:12:48,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, UNASSIGN}] 2023-07-14 18:12:48,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, UNASSIGN 2023-07-14 18:12:48,304 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, UNASSIGN 2023-07-14 18:12:48,306 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5b9fc8554bfc97fd48b1403d3cd25e20, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:12:48,306 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358368306"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358368306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358368306"}]},"ts":"1689358368306"} 2023-07-14 18:12:48,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c79656b172372990d8fe11e027c7a5d5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:12:48,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358368307"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689358368307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689358368307"}]},"ts":"1689358368307"} 2023-07-14 18:12:48,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 5b9fc8554bfc97fd48b1403d3cd25e20, server=jenkins-hbase20.apache.org,38741,1689358246539}] 2023-07-14 18:12:48,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c79656b172372990d8fe11e027c7a5d5, server=jenkins-hbase20.apache.org,34403,1689358246599}] 2023-07-14 18:12:48,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 18:12:48,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:48,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5b9fc8554bfc97fd48b1403d3cd25e20, disabling compactions & flushes 2023-07-14 18:12:48,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:48,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:48,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. after waiting 0 ms 2023-07-14 18:12:48,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:48,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:48,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c79656b172372990d8fe11e027c7a5d5, disabling compactions & flushes 2023-07-14 18:12:48,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:48,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:48,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. after waiting 0 ms 2023-07-14 18:12:48,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:48,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:48,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:12:48,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:48,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:12:48,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20. 2023-07-14 18:12:48,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5b9fc8554bfc97fd48b1403d3cd25e20: 2023-07-14 18:12:48,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5. 2023-07-14 18:12:48,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c79656b172372990d8fe11e027c7a5d5: 2023-07-14 18:12:48,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:48,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:48,527 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c79656b172372990d8fe11e027c7a5d5, regionState=CLOSED 2023-07-14 18:12:48,527 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358368527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358368527"}]},"ts":"1689358368527"} 2023-07-14 18:12:48,528 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5b9fc8554bfc97fd48b1403d3cd25e20, regionState=CLOSED 2023-07-14 18:12:48,528 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689358368528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689358368528"}]},"ts":"1689358368528"} 2023-07-14 18:12:48,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 18:12:48,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c79656b172372990d8fe11e027c7a5d5, server=jenkins-hbase20.apache.org,34403,1689358246599 in 219 msec 2023-07-14 18:12:48,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 18:12:48,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 5b9fc8554bfc97fd48b1403d3cd25e20, server=jenkins-hbase20.apache.org,38741,1689358246539 in 221 msec 2023-07-14 18:12:48,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c79656b172372990d8fe11e027c7a5d5, UNASSIGN in 232 msec 2023-07-14 18:12:48,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-14 18:12:48,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b9fc8554bfc97fd48b1403d3cd25e20, UNASSIGN in 233 msec 2023-07-14 18:12:48,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689358368537"}]},"ts":"1689358368537"} 2023-07-14 18:12:48,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 18:12:48,539 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 18:12:48,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 249 msec 2023-07-14 18:12:48,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 18:12:48,600 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 18:12:48,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,608 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34403] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,610 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,610 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,610 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,610 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 18:12:48,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 18:12:48,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 18:12:48,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,612 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 18:12:48,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 18:12:48,626 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:48,627 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:48,629 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/recovered.edits] 2023-07-14 18:12:48,629 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf, FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/recovered.edits] 2023-07-14 18:12:48,634 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/cf/a3e43f6565004a16b3bc10126568ff15 2023-07-14 18:12:48,635 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/cf/ded06c72870840ab9e1ff6a90f2a0b47 2023-07-14 18:12:48,640 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20/recovered.edits/9.seqid 2023-07-14 18:12:48,642 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b9fc8554bfc97fd48b1403d3cd25e20 2023-07-14 18:12:48,644 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/recovered.edits/9.seqid to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5/recovered.edits/9.seqid 2023-07-14 18:12:48,645 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c79656b172372990d8fe11e027c7a5d5 2023-07-14 18:12:48,645 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 18:12:48,645 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 18:12:48,646 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-14 18:12:48,650 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071407a5dc927633456796552d5633b23142 2023-07-14 18:12:48,654 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046 to hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ee4483c31aa944aa886a7dcb9d172046 2023-07-14 18:12:48,655 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 18:12:48,664 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,666 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 18:12:48,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 18:12:48,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 18:12:48,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358368674"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:48,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689358368674"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:48,677 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 18:12:48,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b9fc8554bfc97fd48b1403d3cd25e20, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689358350836.5b9fc8554bfc97fd48b1403d3cd25e20.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c79656b172372990d8fe11e027c7a5d5, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689358350836.c79656b172372990d8fe11e027c7a5d5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 18:12:48,678 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 18:12:48,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689358368678"}]},"ts":"9223372036854775807"} 2023-07-14 18:12:48,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 18:12:48,686 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 85 msec 2023-07-14 18:12:48,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 18:12:48,715 INFO [Listener at jenkins-hbase20.apache.org/37587] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 18:12:48,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 18:12:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 18:12:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44973] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 18:12:48,760 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 761), OpenFileDescriptor=904 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=436 (was 407) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=1084 (was 1760) 2023-07-14 18:12:48,760 WARN [Listener at jenkins-hbase20.apache.org/37587] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 18:12:48,761 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 18:12:48,777 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-14 18:12:53,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689358255347_0007_000001 (auth:SIMPLE) 2023-07-14 18:12:54,095 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 18:13:02,906 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-14 18:13:17,018 ERROR [Thread[Thread-412,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 18:13:17,019 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-14 18:13:17,125 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 18:13:17,133 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 18:13:17,137 ERROR [Thread[Thread-422,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 18:13:17,160 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-14 18:13:17,266 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 18:13:17,269 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 18:13:17,269 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 18:13:17,269 INFO [Listener at jenkins-hbase20.apache.org/37587] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 18:13:17,269 DEBUG [Listener at jenkins-hbase20.apache.org/37587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cf79b50 to 127.0.0.1:57638 2023-07-14 18:13:17,269 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,269 DEBUG [Listener at jenkins-hbase20.apache.org/37587] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 18:13:17,270 DEBUG [Listener at jenkins-hbase20.apache.org/37587] util.JVMClusterUtil(257): Found active master hash=1102123310, stopped=false 2023-07-14 18:13:17,270 DEBUG [Listener at jenkins-hbase20.apache.org/37587] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,270 DEBUG [Listener at jenkins-hbase20.apache.org/37587] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 18:13:17,270 INFO [Listener at jenkins-hbase20.apache.org/37587] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:13:17,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 18:13:17,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 18:13:17,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 18:13:17,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:13:17,271 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 18:13:17,272 INFO [Listener at jenkins-hbase20.apache.org/37587] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 18:13:17,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:13:17,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:13:17,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:13:17,272 DEBUG [Listener at jenkins-hbase20.apache.org/37587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a5928a to 127.0.0.1:57638 2023-07-14 18:13:17,272 DEBUG [Listener at jenkins-hbase20.apache.org/37587] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,272 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38741,1689358246539' ***** 2023-07-14 18:13:17,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,273 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 18:13:17,273 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34403,1689358246599' ***** 2023-07-14 18:13:17,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,273 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 18:13:17,273 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,34151,1689358246638' ***** 2023-07-14 18:13:17,273 DEBUG [Listener at jenkins-hbase20.apache.org/37587] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,273 INFO [Listener at jenkins-hbase20.apache.org/37587] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 18:13:17,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 18:13:17,273 INFO [RS:0;jenkins-hbase20:38741] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 18:13:17,274 INFO [RS:0;jenkins-hbase20:38741] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 18:13:17,274 INFO [RS:0;jenkins-hbase20:38741] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 18:13:17,274 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:13:17,274 DEBUG [RS:0;jenkins-hbase20:38741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f5d11ef to 127.0.0.1:57638 2023-07-14 18:13:17,274 DEBUG [RS:0;jenkins-hbase20:38741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,274 INFO [RS:1;jenkins-hbase20:34403] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 18:13:17,277 INFO [RS:1;jenkins-hbase20:34403] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 18:13:17,277 INFO [RS:1;jenkins-hbase20:34403] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 18:13:17,277 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(3305): Received CLOSE for 77a92e75cc79d4f3b63a26b004e309a0 2023-07-14 18:13:17,277 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(3305): Received CLOSE for 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:13:17,278 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:13:17,278 DEBUG [RS:1;jenkins-hbase20:34403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18091aca to 127.0.0.1:57638 2023-07-14 18:13:17,278 DEBUG [RS:1;jenkins-hbase20:34403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 18:13:17,277 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 18:13:17,274 INFO [RS:2;jenkins-hbase20:34151] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 18:13:17,278 INFO [RS:2;jenkins-hbase20:34151] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 18:13:17,278 INFO [RS:2;jenkins-hbase20:34151] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 18:13:17,278 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:13:17,278 DEBUG [RS:2;jenkins-hbase20:34151] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4daa0065 to 127.0.0.1:57638 2023-07-14 18:13:17,278 DEBUG [RS:2;jenkins-hbase20:34151] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,278 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 18:13:17,282 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38741,1689358246539; all regions closed. 2023-07-14 18:13:17,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 77a92e75cc79d4f3b63a26b004e309a0, disabling compactions & flushes 2023-07-14 18:13:17,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:13:17,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:13:17,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. after waiting 0 ms 2023-07-14 18:13:17,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:13:17,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 77a92e75cc79d4f3b63a26b004e309a0 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 18:13:17,283 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 18:13:17,284 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1478): Online Regions={77a92e75cc79d4f3b63a26b004e309a0=hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0., 7f8a6003a2c230c6d1cd0121282a5f92=hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92.} 2023-07-14 18:13:17,286 DEBUG [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1504): Waiting on 77a92e75cc79d4f3b63a26b004e309a0, 7f8a6003a2c230c6d1cd0121282a5f92 2023-07-14 18:13:17,284 INFO [RS:2;jenkins-hbase20:34151] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 18:13:17,286 INFO [RS:2;jenkins-hbase20:34151] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 18:13:17,286 INFO [RS:2;jenkins-hbase20:34151] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 18:13:17,286 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 18:13:17,291 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 18:13:17,291 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-14 18:13:17,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 18:13:17,292 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 18:13:17,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 18:13:17,293 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 18:13:17,293 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 18:13:17,293 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 18:13:17,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-14 18:13:17,331 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,332 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,364 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,372 DEBUG [RS:0;jenkins-hbase20:38741] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs 2023-07-14 18:13:17,372 INFO [RS:0;jenkins-hbase20:38741] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38741%2C1689358246539:(num 1689358248763) 2023-07-14 18:13:17,372 DEBUG [RS:0;jenkins-hbase20:38741] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,372 INFO [RS:0;jenkins-hbase20:38741] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,375 INFO [RS:0;jenkins-hbase20:38741] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 18:13:17,375 INFO [RS:0;jenkins-hbase20:38741] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 18:13:17,375 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 18:13:17,375 INFO [RS:0;jenkins-hbase20:38741] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 18:13:17,375 INFO [RS:0;jenkins-hbase20:38741] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 18:13:17,380 INFO [RS:0;jenkins-hbase20:38741] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38741 2023-07-14 18:13:17,386 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:13:17,386 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,386 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:13:17,387 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,389 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38741,1689358246539 2023-07-14 18:13:17,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/.tmp/l/01936e3f0a1b43b7a404c449426a314d 2023-07-14 18:13:17,389 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,389 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/info/b6e9055de82547fdb7b3296206bb0746 2023-07-14 18:13:17,391 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38741,1689358246539] 2023-07-14 18:13:17,392 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38741,1689358246539; numProcessing=1 2023-07-14 18:13:17,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01936e3f0a1b43b7a404c449426a314d 2023-07-14 18:13:17,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6e9055de82547fdb7b3296206bb0746 2023-07-14 18:13:17,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/.tmp/l/01936e3f0a1b43b7a404c449426a314d as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/l/01936e3f0a1b43b7a404c449426a314d 2023-07-14 18:13:17,400 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38741,1689358246539 already deleted, retry=false 2023-07-14 18:13:17,400 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38741,1689358246539 expired; onlineServers=2 2023-07-14 18:13:17,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01936e3f0a1b43b7a404c449426a314d 2023-07-14 18:13:17,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/l/01936e3f0a1b43b7a404c449426a314d, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 18:13:17,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 77a92e75cc79d4f3b63a26b004e309a0 in 118ms, sequenceid=18, compaction requested=false 2023-07-14 18:13:17,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/acl/77a92e75cc79d4f3b63a26b004e309a0/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 18:13:17,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:13:17,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 77a92e75cc79d4f3b63a26b004e309a0: 2023-07-14 18:13:17,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689358250208.77a92e75cc79d4f3b63a26b004e309a0. 2023-07-14 18:13:17,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7f8a6003a2c230c6d1cd0121282a5f92, disabling compactions & flushes 2023-07-14 18:13:17,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:13:17,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:13:17,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. after waiting 0 ms 2023-07-14 18:13:17,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:13:17,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 7f8a6003a2c230c6d1cd0121282a5f92 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 18:13:17,419 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/rep_barrier/7131fe3189934e46b6371091d6bef059 2023-07-14 18:13:17,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7131fe3189934e46b6371091d6bef059 2023-07-14 18:13:17,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/.tmp/info/167621899aff40d4be566c90a42b657f 2023-07-14 18:13:17,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/.tmp/info/167621899aff40d4be566c90a42b657f as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/info/167621899aff40d4be566c90a42b657f 2023-07-14 18:13:17,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/info/167621899aff40d4be566c90a42b657f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 18:13:17,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7f8a6003a2c230c6d1cd0121282a5f92 in 29ms, sequenceid=6, compaction requested=false 2023-07-14 18:13:17,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/table/b0ba2106b66d40f2a09eb0dca99a5195 2023-07-14 18:13:17,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0ba2106b66d40f2a09eb0dca99a5195 2023-07-14 18:13:17,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/info/b6e9055de82547fdb7b3296206bb0746 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/info/b6e9055de82547fdb7b3296206bb0746 2023-07-14 18:13:17,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6e9055de82547fdb7b3296206bb0746 2023-07-14 18:13:17,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/info/b6e9055de82547fdb7b3296206bb0746, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 18:13:17,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/rep_barrier/7131fe3189934e46b6371091d6bef059 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/rep_barrier/7131fe3189934e46b6371091d6bef059 2023-07-14 18:13:17,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7131fe3189934e46b6371091d6bef059 2023-07-14 18:13:17,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/rep_barrier/7131fe3189934e46b6371091d6bef059, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 18:13:17,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/.tmp/table/b0ba2106b66d40f2a09eb0dca99a5195 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/table/b0ba2106b66d40f2a09eb0dca99a5195 2023-07-14 18:13:17,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0ba2106b66d40f2a09eb0dca99a5195 2023-07-14 18:13:17,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/table/b0ba2106b66d40f2a09eb0dca99a5195, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 18:13:17,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 141ms, sequenceid=131, compaction requested=false 2023-07-14 18:13:17,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/namespace/7f8a6003a2c230c6d1cd0121282a5f92/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 18:13:17,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:13:17,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7f8a6003a2c230c6d1cd0121282a5f92: 2023-07-14 18:13:17,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689358249359.7f8a6003a2c230c6d1cd0121282a5f92. 2023-07-14 18:13:17,486 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34403,1689358246599; all regions closed. 2023-07-14 18:13:17,489 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,489 INFO [RS:0;jenkins-hbase20:38741] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38741,1689358246539; zookeeper connection closed. 2023-07-14 18:13:17,489 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:38741-0x1008cad96b10001, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,492 DEBUG [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 18:13:17,495 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@cb5828d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@cb5828d 2023-07-14 18:13:17,497 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 18:13:17,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 18:13:17,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 18:13:17,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 18:13:17,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 18:13:17,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 18:13:17,499 DEBUG [RS:1;jenkins-hbase20:34403] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs 2023-07-14 18:13:17,499 INFO [RS:1;jenkins-hbase20:34403] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34403%2C1689358246599:(num 1689358248779) 2023-07-14 18:13:17,499 DEBUG [RS:1;jenkins-hbase20:34403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,499 INFO [RS:1;jenkins-hbase20:34403] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,500 INFO [RS:1;jenkins-hbase20:34403] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 18:13:17,500 INFO [RS:1;jenkins-hbase20:34403] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 18:13:17,500 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 18:13:17,501 INFO [RS:1;jenkins-hbase20:34403] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 18:13:17,501 INFO [RS:1;jenkins-hbase20:34403] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 18:13:17,502 INFO [RS:1;jenkins-hbase20:34403] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34403 2023-07-14 18:13:17,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:13:17,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,503 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34403,1689358246599 2023-07-14 18:13:17,503 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34403,1689358246599] 2023-07-14 18:13:17,503 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34403,1689358246599; numProcessing=2 2023-07-14 18:13:17,504 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34403,1689358246599 already deleted, retry=false 2023-07-14 18:13:17,504 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34403,1689358246599 expired; onlineServers=1 2023-07-14 18:13:17,604 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,604 INFO [RS:1;jenkins-hbase20:34403] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34403,1689358246599; zookeeper connection closed. 2023-07-14 18:13:17,604 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34403-0x1008cad96b10002, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,605 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@507d5473] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@507d5473 2023-07-14 18:13:17,624 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 18:13:17,624 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 18:13:17,693 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,34151,1689358246638; all regions closed. 2023-07-14 18:13:17,701 DEBUG [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs 2023-07-14 18:13:17,701 INFO [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34151%2C1689358246638.meta:.meta(num 1689358248966) 2023-07-14 18:13:17,710 DEBUG [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/oldWALs 2023-07-14 18:13:17,710 INFO [RS:2;jenkins-hbase20:34151] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34151%2C1689358246638:(num 1689358248763) 2023-07-14 18:13:17,710 DEBUG [RS:2;jenkins-hbase20:34151] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,710 INFO [RS:2;jenkins-hbase20:34151] regionserver.LeaseManager(133): Closed leases 2023-07-14 18:13:17,711 INFO [RS:2;jenkins-hbase20:34151] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 18:13:17,711 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 18:13:17,712 INFO [RS:2;jenkins-hbase20:34151] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34151 2023-07-14 18:13:17,714 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 18:13:17,714 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34151,1689358246638 2023-07-14 18:13:17,715 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34151,1689358246638] 2023-07-14 18:13:17,715 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34151,1689358246638; numProcessing=3 2023-07-14 18:13:17,715 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34151,1689358246638 already deleted, retry=false 2023-07-14 18:13:17,715 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34151,1689358246638 expired; onlineServers=0 2023-07-14 18:13:17,715 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44973,1689358245251' ***** 2023-07-14 18:13:17,715 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 18:13:17,716 DEBUG [M:0;jenkins-hbase20:44973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c1b15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-14 18:13:17,716 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44973,1689358245251 2023-07-14 18:13:17,716 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44973,1689358245251; all regions closed. 2023-07-14 18:13:17,716 DEBUG [M:0;jenkins-hbase20:44973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 18:13:17,716 DEBUG [M:0;jenkins-hbase20:44973] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 18:13:17,716 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 18:13:17,716 DEBUG [M:0;jenkins-hbase20:44973] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 18:13:17,716 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689358248286] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689358248286,5,FailOnTimeoutGroup] 2023-07-14 18:13:17,716 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689358248289] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689358248289,5,FailOnTimeoutGroup] 2023-07-14 18:13:17,716 INFO [M:0;jenkins-hbase20:44973] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 18:13:17,716 INFO [M:0;jenkins-hbase20:44973] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 18:13:17,717 INFO [M:0;jenkins-hbase20:44973] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-14 18:13:17,717 DEBUG [M:0;jenkins-hbase20:44973] master.HMaster(1512): Stopping service threads 2023-07-14 18:13:17,717 INFO [M:0;jenkins-hbase20:44973] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 18:13:17,717 ERROR [M:0;jenkins-hbase20:44973] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-14 18:13:17,717 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 18:13:17,718 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 18:13:17,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 18:13:17,718 INFO [M:0;jenkins-hbase20:44973] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 18:13:17,718 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 18:13:17,720 DEBUG [M:0;jenkins-hbase20:44973] zookeeper.ZKUtil(398): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 18:13:17,720 WARN [M:0;jenkins-hbase20:44973] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 18:13:17,720 INFO [M:0;jenkins-hbase20:44973] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 18:13:17,720 INFO [M:0;jenkins-hbase20:44973] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 18:13:17,721 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 18:13:17,721 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:13:17,721 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:13:17,721 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 18:13:17,721 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:13:17,721 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.87 KB heapSize=451.75 KB 2023-07-14 18:13:17,760 INFO [M:0;jenkins-hbase20:44973] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.87 KB at sequenceid=895 (bloomFilter=true), to=hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5204e9b081f4d568197cd455b977226 2023-07-14 18:13:17,769 INFO [M:0;jenkins-hbase20:44973] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5204e9b081f4d568197cd455b977226 2023-07-14 18:13:17,770 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5204e9b081f4d568197cd455b977226 as hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5204e9b081f4d568197cd455b977226 2023-07-14 18:13:17,775 INFO [M:0;jenkins-hbase20:44973] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5204e9b081f4d568197cd455b977226 2023-07-14 18:13:17,775 INFO [M:0;jenkins-hbase20:44973] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46427/user/jenkins/test-data/936c327c-d482-5df7-c931-0eaf4ac76b21/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5204e9b081f4d568197cd455b977226, entries=119, sequenceid=895, filesize=28.6 K 2023-07-14 18:13:17,778 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegion(2948): Finished flush of dataSize ~375.87 KB/384891, heapSize ~451.73 KB/462576, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 55ms, sequenceid=895, compaction requested=false 2023-07-14 18:13:17,790 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 18:13:17,790 DEBUG [M:0;jenkins-hbase20:44973] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 18:13:17,796 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 18:13:17,796 INFO [M:0;jenkins-hbase20:44973] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 18:13:17,799 INFO [M:0;jenkins-hbase20:44973] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44973 2023-07-14 18:13:17,800 DEBUG [M:0;jenkins-hbase20:44973] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44973,1689358245251 already deleted, retry=false 2023-07-14 18:13:17,815 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,815 INFO [RS:2;jenkins-hbase20:34151] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,34151,1689358246638; zookeeper connection closed. 2023-07-14 18:13:17,815 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): regionserver:34151-0x1008cad96b10003, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,818 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@eb9c476] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@eb9c476 2023-07-14 18:13:17,819 INFO [Listener at jenkins-hbase20.apache.org/37587] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 18:13:17,915 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,915 INFO [M:0;jenkins-hbase20:44973] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44973,1689358245251; zookeeper connection closed. 2023-07-14 18:13:17,915 DEBUG [Listener at localhost.localdomain/41397-EventThread] zookeeper.ZKWatcher(600): master:44973-0x1008cad96b10000, quorum=127.0.0.1:57638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 18:13:17,917 WARN [Listener at jenkins-hbase20.apache.org/37587] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 18:13:17,936 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 18:13:18,039 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 18:13:18,039 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-637106721-148.251.75.209-1689358241361 (Datanode Uuid a0eef9ef-e118-4d97-a943-d4c59c5548da) service to localhost.localdomain/127.0.0.1:46427 2023-07-14 18:13:18,041 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data5/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,042 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data6/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,045 WARN [Listener at jenkins-hbase20.apache.org/37587] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 18:13:18,056 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 18:13:18,060 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 18:13:18,060 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-637106721-148.251.75.209-1689358241361 (Datanode Uuid 2ac85d13-978f-4d1f-93ba-4fe2c818686e) service to localhost.localdomain/127.0.0.1:46427 2023-07-14 18:13:18,061 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data4/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,062 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data3/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,063 WARN [Listener at jenkins-hbase20.apache.org/37587] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 18:13:18,077 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 18:13:18,183 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 18:13:18,183 WARN [BP-637106721-148.251.75.209-1689358241361 heartbeating to localhost.localdomain/127.0.0.1:46427] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-637106721-148.251.75.209-1689358241361 (Datanode Uuid 832531d2-ecf5-4cc1-9288-2b21ff1fe7cc) service to localhost.localdomain/127.0.0.1:46427 2023-07-14 18:13:18,183 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data1/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,184 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/12a1f13f-91fa-3af8-bd1b-e0d842dd3f91/cluster_5346d8d1-67aa-1bee-a900-4d614e6ea7b2/dfs/data/data2/current/BP-637106721-148.251.75.209-1689358241361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 18:13:18,216 INFO [Listener at jenkins-hbase20.apache.org/37587] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-14 18:13:18,353 INFO [Listener at jenkins-hbase20.apache.org/37587] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 18:13:18,483 INFO [Listener at jenkins-hbase20.apache.org/37587] hbase.HBaseTestingUtility(1293): Minicluster is down