2023-07-11 20:12:34,478 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-11 20:12:34,728 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39 2023-07-11 20:12:34,728 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-11 20:12:34,776 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 20:12:35,009 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 20:12:35,009 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d, deleteOnExit=true 2023-07-11 20:12:35,010 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 20:12:35,010 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/test.cache.data in system properties and HBase conf 2023-07-11 20:12:35,011 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 20:12:35,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop.log.dir in system properties and HBase conf 2023-07-11 20:12:35,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 20:12:35,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 20:12:35,013 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 20:12:35,327 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 20:12:35,334 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:35,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:35,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 20:12:35,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:35,336 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 20:12:35,337 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 20:12:35,339 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:35,339 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:35,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 20:12:35,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/nfs.dump.dir in system properties and HBase conf 2023-07-11 20:12:35,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir in system properties and HBase conf 2023-07-11 20:12:35,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:35,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 20:12:35,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 20:12:35,994 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:12:35,998 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:12:36,272 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 20:12:36,452 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 20:12:36,468 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:36,504 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:36,553 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_localhost_43959_hdfs____.4kf9nc/webapp 2023-07-11 20:12:36,698 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43959 2023-07-11 20:12:36,739 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:12:36,740 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:12:37,304 WARN [Listener at localhost/36637] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:37,404 WARN [Listener at localhost/36637] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:37,426 WARN [Listener at localhost/36637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:37,434 INFO [Listener at localhost/36637] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:37,443 INFO [Listener at localhost/36637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_localhost_34631_datanode____5m0tx6/webapp 2023-07-11 20:12:37,547 INFO [Listener at localhost/36637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34631 2023-07-11 20:12:38,087 WARN [Listener at localhost/43111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,127 WARN [Listener at localhost/43111] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:38,133 WARN [Listener at localhost/43111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:38,135 INFO [Listener at localhost/43111] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:38,142 INFO [Listener at localhost/43111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_localhost_34127_datanode____29cm1o/webapp 2023-07-11 20:12:38,270 INFO [Listener at localhost/43111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34127 2023-07-11 20:12:38,302 WARN [Listener at localhost/42279] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,335 WARN [Listener at localhost/42279] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:38,338 WARN [Listener at localhost/42279] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:38,341 INFO [Listener at localhost/42279] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:38,355 INFO [Listener at localhost/42279] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_localhost_43787_datanode____.9jtpfm/webapp 2023-07-11 20:12:38,521 INFO [Listener at localhost/42279] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43787 2023-07-11 20:12:38,541 WARN [Listener at localhost/37483] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,780 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b82fc4a9e1963c0: Processing first storage report for DS-27a0b30c-5408-4053-86e7-58725776376f from datanode 16c9c23a-b701-4d89-b638-4bced55da3d0 2023-07-11 20:12:38,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b82fc4a9e1963c0: from storage DS-27a0b30c-5408-4053-86e7-58725776376f node DatanodeRegistration(127.0.0.1:44499, datanodeUuid=16c9c23a-b701-4d89-b638-4bced55da3d0, infoPort=44825, infoSecurePort=0, ipcPort=42279, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda09fd8e7e37fc6e: Processing first storage report for DS-08d40f49-44da-491a-845a-25b15f7c0ad8 from datanode cc5ed67c-4cc6-407a-b895-14e82addc06a 2023-07-11 20:12:38,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda09fd8e7e37fc6e: from storage DS-08d40f49-44da-491a-845a-25b15f7c0ad8 node DatanodeRegistration(127.0.0.1:33933, datanodeUuid=cc5ed67c-4cc6-407a-b895-14e82addc06a, infoPort=36911, infoSecurePort=0, ipcPort=43111, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda09fd8e7e37fc6e: Processing first storage report for DS-adbda402-d41f-41f1-ad6e-52624154eaee from datanode cc5ed67c-4cc6-407a-b895-14e82addc06a 2023-07-11 20:12:38,783 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda09fd8e7e37fc6e: from storage DS-adbda402-d41f-41f1-ad6e-52624154eaee node DatanodeRegistration(127.0.0.1:33933, datanodeUuid=cc5ed67c-4cc6-407a-b895-14e82addc06a, infoPort=36911, infoSecurePort=0, ipcPort=43111, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,783 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b82fc4a9e1963c0: Processing first storage report for DS-5013f5d1-5b05-4984-8e4d-d96440c07dc1 from datanode 16c9c23a-b701-4d89-b638-4bced55da3d0 2023-07-11 20:12:38,783 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b82fc4a9e1963c0: from storage DS-5013f5d1-5b05-4984-8e4d-d96440c07dc1 node DatanodeRegistration(127.0.0.1:44499, datanodeUuid=16c9c23a-b701-4d89-b638-4bced55da3d0, infoPort=44825, infoSecurePort=0, ipcPort=42279, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,820 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe258fc9b5d6b64ce: Processing first storage report for DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f from datanode 1c858034-b24b-4dfb-8890-09bcc53afbe9 2023-07-11 20:12:38,820 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe258fc9b5d6b64ce: from storage DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f node DatanodeRegistration(127.0.0.1:41921, datanodeUuid=1c858034-b24b-4dfb-8890-09bcc53afbe9, infoPort=45301, infoSecurePort=0, ipcPort=37483, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,820 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe258fc9b5d6b64ce: Processing first storage report for DS-e9060282-d446-413d-b158-27d75de4b59d from datanode 1c858034-b24b-4dfb-8890-09bcc53afbe9 2023-07-11 20:12:38,820 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe258fc9b5d6b64ce: from storage DS-e9060282-d446-413d-b158-27d75de4b59d node DatanodeRegistration(127.0.0.1:41921, datanodeUuid=1c858034-b24b-4dfb-8890-09bcc53afbe9, infoPort=45301, infoSecurePort=0, ipcPort=37483, storageInfo=lv=-57;cid=testClusterID;nsid=565208844;c=1689106356066), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:39,086 DEBUG [Listener at localhost/37483] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39 2023-07-11 20:12:39,172 INFO [Listener at localhost/37483] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/zookeeper_0, clientPort=50019, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 20:12:39,192 INFO [Listener at localhost/37483] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50019 2023-07-11 20:12:39,203 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:39,206 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:39,965 INFO [Listener at localhost/37483] util.FSUtils(471): Created version file at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 with version=8 2023-07-11 20:12:39,965 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/hbase-staging 2023-07-11 20:12:40,356 INFO [Listener at localhost/37483] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 20:12:41,076 INFO [Listener at localhost/37483] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,127 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,128 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,129 INFO [Listener at localhost/37483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,129 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,129 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,310 INFO [Listener at localhost/37483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,400 DEBUG [Listener at localhost/37483] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 20:12:41,543 INFO [Listener at localhost/37483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38559 2023-07-11 20:12:41,563 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,566 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,597 INFO [Listener at localhost/37483] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38559 connecting to ZooKeeper ensemble=127.0.0.1:50019 2023-07-11 20:12:41,650 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:385590x0, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38559-0x1015604266f0000 connected 2023-07-11 20:12:41,685 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,686 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,704 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,713 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38559 2023-07-11 20:12:41,714 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38559 2023-07-11 20:12:41,718 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38559 2023-07-11 20:12:41,722 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38559 2023-07-11 20:12:41,723 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38559 2023-07-11 20:12:41,731 INFO [Listener at localhost/37483] master.HMaster(444): hbase.rootdir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, hbase.cluster.distributed=false 2023-07-11 20:12:41,800 INFO [Listener at localhost/37483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,800 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,800 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,800 INFO [Listener at localhost/37483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,800 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,801 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,805 INFO [Listener at localhost/37483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,811 INFO [Listener at localhost/37483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35437 2023-07-11 20:12:41,815 INFO [Listener at localhost/37483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:41,830 DEBUG [Listener at localhost/37483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:12:41,832 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,835 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,837 INFO [Listener at localhost/37483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35437 connecting to ZooKeeper ensemble=127.0.0.1:50019 2023-07-11 20:12:41,850 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:354370x0, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,851 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:354370x0, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35437-0x1015604266f0001 connected 2023-07-11 20:12:41,853 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,854 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,855 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35437 2023-07-11 20:12:41,856 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35437 2023-07-11 20:12:41,858 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35437 2023-07-11 20:12:41,864 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35437 2023-07-11 20:12:41,864 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35437 2023-07-11 20:12:41,877 INFO [Listener at localhost/37483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,877 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,877 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,878 INFO [Listener at localhost/37483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,878 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,879 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,879 INFO [Listener at localhost/37483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,883 INFO [Listener at localhost/37483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46545 2023-07-11 20:12:41,884 INFO [Listener at localhost/37483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:41,885 DEBUG [Listener at localhost/37483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:12:41,886 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,893 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,896 INFO [Listener at localhost/37483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46545 connecting to ZooKeeper ensemble=127.0.0.1:50019 2023-07-11 20:12:41,901 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:465450x0, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,903 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:465450x0, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,904 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:465450x0, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,905 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:465450x0, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46545-0x1015604266f0002 connected 2023-07-11 20:12:41,910 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46545 2023-07-11 20:12:41,912 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46545 2023-07-11 20:12:41,913 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46545 2023-07-11 20:12:41,914 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46545 2023-07-11 20:12:41,914 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46545 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,928 INFO [Listener at localhost/37483] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,930 INFO [Listener at localhost/37483] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41061 2023-07-11 20:12:41,930 INFO [Listener at localhost/37483] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:41,932 DEBUG [Listener at localhost/37483] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 20:12:41,933 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,935 INFO [Listener at localhost/37483] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,936 INFO [Listener at localhost/37483] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41061 connecting to ZooKeeper ensemble=127.0.0.1:50019 2023-07-11 20:12:41,951 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:410610x0, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,952 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:410610x0, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41061-0x1015604266f0003 connected 2023-07-11 20:12:41,954 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,955 DEBUG [Listener at localhost/37483] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,962 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41061 2023-07-11 20:12:41,963 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41061 2023-07-11 20:12:41,966 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41061 2023-07-11 20:12:41,967 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41061 2023-07-11 20:12:41,967 DEBUG [Listener at localhost/37483] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41061 2023-07-11 20:12:41,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:41,984 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:12:41,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:42,014 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,014 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:42,014 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,015 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,015 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:12:42,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:12:42,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38559,1689106360147 from backup master directory 2023-07-11 20:12:42,035 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:42,035 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:12:42,036 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:42,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:42,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 20:12:42,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 20:12:42,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/hbase.id with ID: d0223e45-5781-40f2-917d-b5f840ff88ac 2023-07-11 20:12:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,234 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:42,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7000d2f6 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:42,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52111f98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:42,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:42,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 20:12:42,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 20:12:42,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 20:12:42,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:42,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store-tmp 2023-07-11 20:12:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:12:42,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:12:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:12:42,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/WALs/jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:42,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38559%2C1689106360147, suffix=, logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/WALs/jenkins-hbase4.apache.org,38559,1689106360147, archiveDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/oldWALs, maxLogs=10 2023-07-11 20:12:42,644 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK] 2023-07-11 20:12:42,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK] 2023-07-11 20:12:42,644 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK] 2023-07-11 20:12:42,656 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/WALs/jenkins-hbase4.apache.org,38559,1689106360147/jenkins-hbase4.apache.org%2C38559%2C1689106360147.1689106362572 2023-07-11 20:12:42,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK], DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK], DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK]] 2023-07-11 20:12:42,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:42,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:42,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,850 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,860 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 20:12:42,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 20:12:42,904 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:42,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:42,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66348866, jitterRate=-0.011324852705001831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:42,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:12:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 20:12:42,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 20:12:42,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 20:12:42,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:12:42,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:12:43,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-11 20:12:43,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 20:12:43,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 20:12:43,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 20:12:43,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 20:12:43,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 20:12:43,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 20:12:43,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 20:12:43,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 20:12:43,109 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 20:12:43,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 20:12:43,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 20:12:43,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,137 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,137 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,137 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38559,1689106360147, sessionid=0x1015604266f0000, setting cluster-up flag (Was=false) 2023-07-11 20:12:43,160 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 20:12:43,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:43,176 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 20:12:43,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:43,193 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp 2023-07-11 20:12:43,282 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(951): ClusterId : d0223e45-5781-40f2-917d-b5f840ff88ac 2023-07-11 20:12:43,283 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(951): ClusterId : d0223e45-5781-40f2-917d-b5f840ff88ac 2023-07-11 20:12:43,284 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(951): ClusterId : d0223e45-5781-40f2-917d-b5f840ff88ac 2023-07-11 20:12:43,294 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,295 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,294 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-11 20:12:43,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-11 20:12:43,312 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,312 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,312 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,312 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,312 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,312 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,318 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,318 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,320 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ReadOnlyZKClient(139): Connect 0x3f647398 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,321 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ReadOnlyZKClient(139): Connect 0x7aba686b to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,320 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,325 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ReadOnlyZKClient(139): Connect 0x01fdae2a to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,355 DEBUG [RS:1;jenkins-hbase4:46545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b1ace3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,356 DEBUG [RS:1;jenkins-hbase4:46545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f0a44b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,411 DEBUG [RS:2;jenkins-hbase4:41061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf40c56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,411 DEBUG [RS:2;jenkins-hbase4:41061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f97ac8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,413 DEBUG [RS:0;jenkins-hbase4:35437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52d2d8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,413 DEBUG [RS:0;jenkins-hbase4:35437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54fcc22a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,426 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35437 2023-07-11 20:12:43,426 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41061 2023-07-11 20:12:43,431 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46545 2023-07-11 20:12:43,439 INFO [RS:0;jenkins-hbase4:35437] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,439 INFO [RS:0;jenkins-hbase4:35437] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,440 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,439 INFO [RS:1;jenkins-hbase4:46545] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,444 INFO [RS:1;jenkins-hbase4:46545] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,444 INFO [RS:0;jenkins-hbase4:35437] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,445 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,445 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,445 INFO [RS:1;jenkins-hbase4:46545] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,445 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,439 INFO [RS:2;jenkins-hbase4:41061] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,447 INFO [RS:2;jenkins-hbase4:41061] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,447 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,447 INFO [RS:2;jenkins-hbase4:41061] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,450 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,451 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38559,1689106360147 with isa=jenkins-hbase4.apache.org/172.31.14.131:35437, startcode=1689106361799 2023-07-11 20:12:43,451 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38559,1689106360147 with isa=jenkins-hbase4.apache.org/172.31.14.131:41061, startcode=1689106361927 2023-07-11 20:12:43,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:43,454 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38559,1689106360147 with isa=jenkins-hbase4.apache.org/172.31.14.131:46545, startcode=1689106361876 2023-07-11 20:12:43,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-11 20:12:43,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,472 DEBUG [RS:1;jenkins-hbase4:46545] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,472 DEBUG [RS:0;jenkins-hbase4:35437] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,472 DEBUG [RS:2;jenkins-hbase4:41061] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689106393473 2023-07-11 20:12:43,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 20:12:43,481 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:43,481 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 20:12:43,487 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:43,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 20:12:43,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 20:12:43,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 20:12:43,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 20:12:43,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 20:12:43,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 20:12:43,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 20:12:43,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 20:12:43,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 20:12:43,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 20:12:43,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363544,5,FailOnTimeoutGroup] 2023-07-11 20:12:43,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363549,5,FailOnTimeoutGroup] 2023-07-11 20:12:43,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 20:12:43,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,585 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57031, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,585 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56941, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,585 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40901, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,623 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:43,625 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:43,628 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38559] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,635 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:43,651 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38559] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,653 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38559] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,660 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:43,661 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:43,663 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36637 2023-07-11 20:12:43,663 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,663 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:43,661 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36637 2023-07-11 20:12:43,668 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,666 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36637 2023-07-11 20:12:43,668 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,675 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:12:43,677 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ZKUtil(162): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,678 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ZKUtil(162): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,678 WARN [RS:2;jenkins-hbase4:41061] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,678 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ZKUtil(162): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,680 INFO [RS:2;jenkins-hbase4:41061] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,680 WARN [RS:0;jenkins-hbase4:35437] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,681 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,680 WARN [RS:1;jenkins-hbase4:46545] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,681 INFO [RS:0;jenkins-hbase4:35437] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,690 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,681 INFO [RS:1;jenkins-hbase4:46545] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,691 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,693 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46545,1689106361876] 2023-07-11 20:12:43,693 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41061,1689106361927] 2023-07-11 20:12:43,693 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35437,1689106361799] 2023-07-11 20:12:43,728 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:43,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:12:43,732 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ZKUtil(162): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,732 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ZKUtil(162): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,732 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ZKUtil(162): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,733 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ZKUtil(162): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,733 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ZKUtil(162): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,733 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ZKUtil(162): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,733 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ZKUtil(162): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,734 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ZKUtil(162): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,734 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ZKUtil(162): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,735 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/info 2023-07-11 20:12:43,736 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:12:43,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:12:43,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:43,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:12:43,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:12:43,746 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/table 2023-07-11 20:12:43,747 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:12:43,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,755 DEBUG [RS:1;jenkins-hbase4:46545] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,760 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740 2023-07-11 20:12:43,761 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740 2023-07-11 20:12:43,763 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,764 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,768 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:12:43,771 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:12:43,772 INFO [RS:0;jenkins-hbase4:35437] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,772 INFO [RS:1;jenkins-hbase4:46545] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,776 INFO [RS:2;jenkins-hbase4:41061] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,779 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:43,780 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73256366, jitterRate=0.09160491824150085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:12:43,780 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:12:43,780 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:12:43,780 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:12:43,780 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:12:43,780 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:12:43,780 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:12:43,784 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:12:43,784 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:12:43,790 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:43,790 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 20:12:43,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 20:12:43,817 INFO [RS:1;jenkins-hbase4:46545] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,817 INFO [RS:2;jenkins-hbase4:41061] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,817 INFO [RS:0;jenkins-hbase4:35437] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,824 INFO [RS:1;jenkins-hbase4:46545] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,824 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,828 INFO [RS:0;jenkins-hbase4:35437] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,835 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:12:43,835 INFO [RS:2;jenkins-hbase4:41061] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,836 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,835 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,836 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,839 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 20:12:43,850 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,850 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,866 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,867 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,866 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,867 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,867 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,867 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,868 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,869 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,868 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:2;jenkins-hbase4:41061] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:0;jenkins-hbase4:35437] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,869 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,870 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,870 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,870 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,871 DEBUG [RS:1;jenkins-hbase4:46545] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,877 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,883 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,884 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,884 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,884 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,884 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,903 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,903 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,903 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,911 INFO [RS:2;jenkins-hbase4:41061] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:43,914 INFO [RS:0;jenkins-hbase4:35437] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:43,916 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41061,1689106361927-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,917 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35437,1689106361799-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,924 INFO [RS:1;jenkins-hbase4:46545] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:43,924 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46545,1689106361876-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,955 INFO [RS:1;jenkins-hbase4:46545] regionserver.Replication(203): jenkins-hbase4.apache.org,46545,1689106361876 started 2023-07-11 20:12:43,956 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46545,1689106361876, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46545, sessionid=0x1015604266f0002 2023-07-11 20:12:43,958 INFO [RS:2;jenkins-hbase4:41061] regionserver.Replication(203): jenkins-hbase4.apache.org,41061,1689106361927 started 2023-07-11 20:12:43,958 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41061,1689106361927, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41061, sessionid=0x1015604266f0003 2023-07-11 20:12:43,958 INFO [RS:0;jenkins-hbase4:35437] regionserver.Replication(203): jenkins-hbase4.apache.org,35437,1689106361799 started 2023-07-11 20:12:43,959 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35437,1689106361799, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35437, sessionid=0x1015604266f0001 2023-07-11 20:12:43,959 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:43,959 DEBUG [RS:0;jenkins-hbase4:35437] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,959 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35437,1689106361799' 2023-07-11 20:12:43,959 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:43,958 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:43,958 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:43,961 DEBUG [RS:2;jenkins-hbase4:41061] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,961 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:43,960 DEBUG [RS:1;jenkins-hbase4:46545] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,961 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41061,1689106361927' 2023-07-11 20:12:43,962 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:43,962 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46545,1689106361876' 2023-07-11 20:12:43,963 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:43,963 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:43,963 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:43,963 DEBUG [RS:0;jenkins-hbase4:35437] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:43,963 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:43,963 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:43,963 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35437,1689106361799' 2023-07-11 20:12:43,964 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:43,964 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:43,964 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:43,964 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:43,964 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:43,964 DEBUG [RS:1;jenkins-hbase4:46545] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:43,964 DEBUG [RS:0;jenkins-hbase4:35437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:43,965 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46545,1689106361876' 2023-07-11 20:12:43,965 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:43,965 DEBUG [RS:2;jenkins-hbase4:41061] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:43,965 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41061,1689106361927' 2023-07-11 20:12:43,965 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:43,966 DEBUG [RS:0;jenkins-hbase4:35437] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:43,966 DEBUG [RS:1;jenkins-hbase4:46545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:43,966 INFO [RS:0;jenkins-hbase4:35437] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:43,966 DEBUG [RS:2;jenkins-hbase4:41061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:43,966 INFO [RS:0;jenkins-hbase4:35437] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:43,968 DEBUG [RS:1;jenkins-hbase4:46545] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:43,969 DEBUG [RS:2;jenkins-hbase4:41061] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:43,969 INFO [RS:2;jenkins-hbase4:41061] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:43,968 INFO [RS:1;jenkins-hbase4:46545] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:43,969 INFO [RS:2;jenkins-hbase4:41061] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:43,969 INFO [RS:1;jenkins-hbase4:46545] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:44,008 DEBUG [jenkins-hbase4:38559] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 20:12:44,014 DEBUG [jenkins-hbase4:38559] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:44,025 DEBUG [jenkins-hbase4:38559] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:44,026 DEBUG [jenkins-hbase4:38559] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:44,026 DEBUG [jenkins-hbase4:38559] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:44,026 DEBUG [jenkins-hbase4:38559] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:44,029 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35437,1689106361799, state=OPENING 2023-07-11 20:12:44,039 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 20:12:44,041 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:44,042 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:12:44,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:12:44,090 INFO [RS:1;jenkins-hbase4:46545] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46545%2C1689106361876, suffix=, logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,46545,1689106361876, archiveDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs, maxLogs=32 2023-07-11 20:12:44,093 INFO [RS:2;jenkins-hbase4:41061] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41061%2C1689106361927, suffix=, logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,41061,1689106361927, archiveDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs, maxLogs=32 2023-07-11 20:12:44,091 INFO [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35437%2C1689106361799, suffix=, logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,35437,1689106361799, archiveDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs, maxLogs=32 2023-07-11 20:12:44,140 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK] 2023-07-11 20:12:44,142 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK] 2023-07-11 20:12:44,149 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK] 2023-07-11 20:12:44,153 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK] 2023-07-11 20:12:44,159 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK] 2023-07-11 20:12:44,159 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK] 2023-07-11 20:12:44,161 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK] 2023-07-11 20:12:44,161 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK] 2023-07-11 20:12:44,162 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK] 2023-07-11 20:12:44,172 INFO [RS:2;jenkins-hbase4:41061] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,41061,1689106361927/jenkins-hbase4.apache.org%2C41061%2C1689106361927.1689106364100 2023-07-11 20:12:44,173 INFO [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,35437,1689106361799/jenkins-hbase4.apache.org%2C35437%2C1689106361799.1689106364108 2023-07-11 20:12:44,175 DEBUG [RS:2;jenkins-hbase4:41061] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK], DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK], DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK]] 2023-07-11 20:12:44,175 DEBUG [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK], DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK], DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK]] 2023-07-11 20:12:44,175 INFO [RS:1;jenkins-hbase4:46545] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,46545,1689106361876/jenkins-hbase4.apache.org%2C46545%2C1689106361876.1689106364097 2023-07-11 20:12:44,178 DEBUG [RS:1;jenkins-hbase4:46545] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK], DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK], DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK]] 2023-07-11 20:12:44,317 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:44,321 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:12:44,331 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:12:44,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 20:12:44,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:44,363 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35437%2C1689106361799.meta, suffix=.meta, logDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,35437,1689106361799, archiveDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs, maxLogs=32 2023-07-11 20:12:44,386 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK] 2023-07-11 20:12:44,387 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK] 2023-07-11 20:12:44,388 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK] 2023-07-11 20:12:44,392 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/WALs/jenkins-hbase4.apache.org,35437,1689106361799/jenkins-hbase4.apache.org%2C35437%2C1689106361799.meta.1689106364365.meta 2023-07-11 20:12:44,394 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44499,DS-27a0b30c-5408-4053-86e7-58725776376f,DISK], DatanodeInfoWithStorage[127.0.0.1:41921,DS-9e1c14a2-fcd3-473f-9947-c32e13c1770f,DISK], DatanodeInfoWithStorage[127.0.0.1:33933,DS-08d40f49-44da-491a-845a-25b15f7c0ad8,DISK]] 2023-07-11 20:12:44,395 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:44,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-11 20:12:44,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:44,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 20:12:44,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 20:12:44,413 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 20:12:44,427 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 20:12:44,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:44,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 20:12:44,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 20:12:44,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:12:44,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/info 2023-07-11 20:12:44,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/info 2023-07-11 20:12:44,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:12:44,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:12:44,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:44,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:44,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:12:44,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:12:44,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/table 2023-07-11 20:12:44,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/table 2023-07-11 20:12:44,456 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:12:44,457 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740 2023-07-11 20:12:44,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740 2023-07-11 20:12:44,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:12:44,477 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:12:44,480 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66041138, jitterRate=-0.015910357236862183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:12:44,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:12:44,493 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689106364307 2023-07-11 20:12:44,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 20:12:44,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 20:12:44,518 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35437,1689106361799, state=OPEN 2023-07-11 20:12:44,522 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 20:12:44,522 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:12:44,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 20:12:44,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35437,1689106361799 in 470 msec 2023-07-11 20:12:44,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 20:12:44,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 720 msec 2023-07-11 20:12:44,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2250 sec 2023-07-11 20:12:44,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689106364545, completionTime=-1 2023-07-11 20:12:44,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 20:12:44,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:12:44,639 DEBUG [hconnection-0x1fb663b0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:44,643 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:44,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 20:12:44,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689106424671 2023-07-11 20:12:44,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689106484671 2023-07-11 20:12:44,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 125 msec 2023-07-11 20:12:44,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1689106360147-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1689106360147-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1689106360147-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38559, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,717 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 20:12:44,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 20:12:44,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:44,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 20:12:44,743 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:44,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:44,774 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:44,777 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014 empty. 2023-07-11 20:12:44,778 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:44,778 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 20:12:44,832 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:44,835 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f8f2682993679ca00be6ddc6853bf014, NAME => 'hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f8f2682993679ca00be6ddc6853bf014, disabling compactions & flushes 2023-07-11 20:12:44,870 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. after waiting 0 ms 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:44,870 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:44,870 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f8f2682993679ca00be6ddc6853bf014: 2023-07-11 20:12:44,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:44,898 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106364885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106364885"}]},"ts":"1689106364885"} 2023-07-11 20:12:44,939 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 20:12:44,941 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:44,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106364941"}]},"ts":"1689106364941"} 2023-07-11 20:12:44,954 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 20:12:44,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:44,959 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:44,959 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:44,959 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:44,959 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:44,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f8f2682993679ca00be6ddc6853bf014, ASSIGN}] 2023-07-11 20:12:44,966 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f8f2682993679ca00be6ddc6853bf014, ASSIGN 2023-07-11 20:12:44,968 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f8f2682993679ca00be6ddc6853bf014, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:12:45,120 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:12:45,121 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f8f2682993679ca00be6ddc6853bf014, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:45,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106365121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106365121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106365121"}]},"ts":"1689106365121"} 2023-07-11 20:12:45,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f8f2682993679ca00be6ddc6853bf014, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:12:45,281 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:45,282 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:12:45,285 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:12:45,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:45,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8f2682993679ca00be6ddc6853bf014, NAME => 'hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:45,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. service=AccessControlService 2023-07-11 20:12:45,293 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:45,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:45,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,296 INFO [StoreOpener-f8f2682993679ca00be6ddc6853bf014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,299 DEBUG [StoreOpener-f8f2682993679ca00be6ddc6853bf014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/info 2023-07-11 20:12:45,299 DEBUG [StoreOpener-f8f2682993679ca00be6ddc6853bf014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/info 2023-07-11 20:12:45,300 INFO [StoreOpener-f8f2682993679ca00be6ddc6853bf014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8f2682993679ca00be6ddc6853bf014 columnFamilyName info 2023-07-11 20:12:45,301 INFO [StoreOpener-f8f2682993679ca00be6ddc6853bf014-1] regionserver.HStore(310): Store=f8f2682993679ca00be6ddc6853bf014/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:45,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:12:45,327 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:45,328 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f8f2682993679ca00be6ddc6853bf014; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61829894, jitterRate=-0.07866278290748596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:45,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f8f2682993679ca00be6ddc6853bf014: 2023-07-11 20:12:45,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014., pid=6, masterSystemTime=1689106365281 2023-07-11 20:12:45,336 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:45,337 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:12:45,338 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f8f2682993679ca00be6ddc6853bf014, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:45,338 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106365337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106365337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106365337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106365337"}]},"ts":"1689106365337"} 2023-07-11 20:12:45,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 20:12:45,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f8f2682993679ca00be6ddc6853bf014, server=jenkins-hbase4.apache.org,41061,1689106361927 in 216 msec 2023-07-11 20:12:45,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 20:12:45,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f8f2682993679ca00be6ddc6853bf014, ASSIGN in 386 msec 2023-07-11 20:12:45,354 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:45,354 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106365354"}]},"ts":"1689106365354"} 2023-07-11 20:12:45,356 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 20:12:45,360 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:45,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 630 msec 2023-07-11 20:12:45,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 20:12:45,446 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,446 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:45,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:45,474 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:45,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 20:12:45,502 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-07-11 20:12:45,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:12:45,532 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-11 20:12:45,546 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 20:12:45,550 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 20:12:45,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.514sec 2023-07-11 20:12:45,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 20:12:45,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 20:12:45,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 20:12:45,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1689106360147-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 20:12:45,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38559,1689106360147-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 20:12:45,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:45,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-11 20:12:45,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:45,583 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:45,585 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/acl/2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:45,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-11 20:12:45,587 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/acl/2617bd4e887dedc964015774fd780f4a empty. 2023-07-11 20:12:45,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/acl/2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:45,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-11 20:12:45,591 DEBUG [Listener at localhost/37483] zookeeper.ReadOnlyZKClient(139): Connect 0x68214c6c to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:45,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:45,598 DEBUG [Listener at localhost/37483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504158e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:45,627 DEBUG [hconnection-0x290efef4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:45,627 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:45,632 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2617bd4e887dedc964015774fd780f4a, NAME => 'hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:12:45,642 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:45,645 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:12:45,646 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-11 20:12:45,646 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/test.cache.data in system properties and HBase conf 2023-07-11 20:12:45,646 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop.log.dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:45,647 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/nfs.dump.dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 20:12:45,648 INFO [Listener at localhost/37483] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2617bd4e887dedc964015774fd780f4a, disabling compactions & flushes 2023-07-11 20:12:45,663 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. after waiting 0 ms 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:45,663 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:45,663 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2617bd4e887dedc964015774fd780f4a: 2023-07-11 20:12:45,668 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:45,669 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106365669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106365669"}]},"ts":"1689106365669"} 2023-07-11 20:12:45,672 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 20:12:45,675 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:45,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106365675"}]},"ts":"1689106365675"} 2023-07-11 20:12:45,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-11 20:12:45,683 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:45,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:45,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:45,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:45,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:45,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2617bd4e887dedc964015774fd780f4a, ASSIGN}] 2023-07-11 20:12:45,688 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2617bd4e887dedc964015774fd780f4a, ASSIGN 2023-07-11 20:12:45,689 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2617bd4e887dedc964015774fd780f4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:12:45,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:45,840 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:12:45,841 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2617bd4e887dedc964015774fd780f4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:45,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106365841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106365841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106365841"}]},"ts":"1689106365841"} 2023-07-11 20:12:45,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2617bd4e887dedc964015774fd780f4a, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:12:45,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:46,052 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:46,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2617bd4e887dedc964015774fd780f4a, NAME => 'hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:46,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. service=AccessControlService 2023-07-11 20:12:46,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:46,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:46,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,056 INFO [StoreOpener-2617bd4e887dedc964015774fd780f4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,060 DEBUG [StoreOpener-2617bd4e887dedc964015774fd780f4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/l 2023-07-11 20:12:46,060 DEBUG [StoreOpener-2617bd4e887dedc964015774fd780f4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/l 2023-07-11 20:12:46,061 INFO [StoreOpener-2617bd4e887dedc964015774fd780f4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2617bd4e887dedc964015774fd780f4a columnFamilyName l 2023-07-11 20:12:46,062 INFO [StoreOpener-2617bd4e887dedc964015774fd780f4a-1] regionserver.HStore(310): Store=2617bd4e887dedc964015774fd780f4a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:46,064 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,066 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:12:46,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:46,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2617bd4e887dedc964015774fd780f4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69027593, jitterRate=0.02859129011631012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:46,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2617bd4e887dedc964015774fd780f4a: 2023-07-11 20:12:46,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a., pid=11, masterSystemTime=1689106366045 2023-07-11 20:12:46,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:46,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:12:46,090 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2617bd4e887dedc964015774fd780f4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:46,091 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106366090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106366090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106366090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106366090"}]},"ts":"1689106366090"} 2023-07-11 20:12:46,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 20:12:46,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2617bd4e887dedc964015774fd780f4a, server=jenkins-hbase4.apache.org,41061,1689106361927 in 250 msec 2023-07-11 20:12:46,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 20:12:46,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2617bd4e887dedc964015774fd780f4a, ASSIGN in 419 msec 2023-07-11 20:12:46,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:46,110 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106366110"}]},"ts":"1689106366110"} 2023-07-11 20:12:46,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-11 20:12:46,119 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:46,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 542 msec 2023-07-11 20:12:46,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:46,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-11 20:12:46,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 20:12:46,982 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:47,292 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:47,299 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38393_jobhistory____1ep2r5/webapp 2023-07-11 20:12:47,483 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-11 20:12:47,483 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:47,483 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:47,486 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:47,559 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:47,838 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:48,103 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-11 20:12:48,192 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38393 2023-07-11 20:12:48,478 WARN [Listener at jenkins-hbase4.apache.org/40633] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:48,872 WARN [Listener at jenkins-hbase4.apache.org/40633] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:48,873 INFO [Listener at jenkins-hbase4.apache.org/40633] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:48,882 INFO [Listener at jenkins-hbase4.apache.org/40633] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37805_cluster____mkeiln/webapp 2023-07-11 20:12:49,017 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:49,017 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-11 20:12:49,017 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:49,018 INFO [Listener at jenkins-hbase4.apache.org/40633] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:49,029 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,267 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,431 INFO [Listener at jenkins-hbase4.apache.org/40633] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,487 INFO [Listener at jenkins-hbase4.apache.org/40633] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37805 2023-07-11 20:12:50,154 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:12:50,255 WARN [Listener at jenkins-hbase4.apache.org/43501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:50,288 WARN [Listener at jenkins-hbase4.apache.org/43501] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:50,288 INFO [Listener at jenkins-hbase4.apache.org/43501] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:50,308 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 20:12:50,310 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 20:12:50,311 INFO [Listener at jenkins-hbase4.apache.org/43501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37265_node____.jox35h/webapp 2023-07-11 20:12:50,311 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-11 20:12:50,349 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,350 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-11 20:12:50,350 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,350 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-11 20:12:50,350 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 20:12:50,350 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-11 20:12:50,351 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,351 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-11 20:12:50,351 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:12:50,351 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 20:12:50,374 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 20:12:50,374 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:50,374 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:50,374 INFO [Listener at jenkins-hbase4.apache.org/43501] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:50,384 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,411 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,532 INFO [Listener at jenkins-hbase4.apache.org/43501] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,558 INFO [Listener at jenkins-hbase4.apache.org/43501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37265 2023-07-11 20:12:50,834 WARN [Listener at jenkins-hbase4.apache.org/35229] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:50,841 WARN [Listener at jenkins-hbase4.apache.org/35229] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:50,842 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:50,848 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44175_node____.4hav77/webapp 2023-07-11 20:12:50,903 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 20:12:50,903 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:50,904 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:50,904 INFO [Listener at jenkins-hbase4.apache.org/35229] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:50,911 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,923 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:51,021 INFO [Listener at jenkins-hbase4.apache.org/35229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:51,030 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44175 2023-07-11 20:12:51,077 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-11 20:12:51,079 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:51,166 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=174, AvailableMemoryMB=3688 2023-07-11 20:12:51,166 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-11 20:12:51,182 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 20:12:51,189 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 20:12:51,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:51,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:12:51,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:51,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-11 20:12:51,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,204 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:51,209 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,211 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 empty. 2023-07-11 20:12:51,211 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 empty. 2023-07-11 20:12:51,212 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,213 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 20:12:51,247 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:51,250 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 64af02dd11316c366831f14bc6dd7414, NAME => 'testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:12:51,250 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d76a6751de3c704f81063615c42b854, NAME => 'testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:12:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,324 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 64af02dd11316c366831f14bc6dd7414, disabling compactions & flushes 2023-07-11 20:12:51,329 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. after waiting 0 ms 2023-07-11 20:12:51,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,329 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 64af02dd11316c366831f14bc6dd7414: 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2d76a6751de3c704f81063615c42b854, disabling compactions & flushes 2023-07-11 20:12:51,332 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. after waiting 0 ms 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,332 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,332 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2d76a6751de3c704f81063615c42b854: 2023-07-11 20:12:51,339 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:51,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106371340"}]},"ts":"1689106371340"} 2023-07-11 20:12:51,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106371340"}]},"ts":"1689106371340"} 2023-07-11 20:12:51,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:12:51,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:51,403 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106371403"}]},"ts":"1689106371403"} 2023-07-11 20:12:51,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-11 20:12:51,412 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:51,414 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:51,414 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:51,414 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:51,414 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:51,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, ASSIGN}] 2023-07-11 20:12:51,417 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, ASSIGN 2023-07-11 20:12:51,418 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, ASSIGN 2023-07-11 20:12:51,419 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35437,1689106361799; forceNewPlan=false, retain=false 2023-07-11 20:12:51,419 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:12:51,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,569 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:12:51,572 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=64af02dd11316c366831f14bc6dd7414, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:51,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2d76a6751de3c704f81063615c42b854, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:51,572 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106371572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106371572"}]},"ts":"1689106371572"} 2023-07-11 20:12:51,572 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106371572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106371572"}]},"ts":"1689106371572"} 2023-07-11 20:12:51,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2d76a6751de3c704f81063615c42b854, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:12:51,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 64af02dd11316c366831f14bc6dd7414, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:12:51,730 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:51,730 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:12:51,734 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:12:51,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d76a6751de3c704f81063615c42b854, NAME => 'testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:12:51,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. service=AccessControlService 2023-07-11 20:12:51,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:51,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64af02dd11316c366831f14bc6dd7414, NAME => 'testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:12:51,739 INFO [StoreOpener-2d76a6751de3c704f81063615c42b854-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. service=AccessControlService 2023-07-11 20:12:51,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:51,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,741 DEBUG [StoreOpener-2d76a6751de3c704f81063615c42b854-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf 2023-07-11 20:12:51,742 DEBUG [StoreOpener-2d76a6751de3c704f81063615c42b854-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf 2023-07-11 20:12:51,742 INFO [StoreOpener-2d76a6751de3c704f81063615c42b854-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d76a6751de3c704f81063615c42b854 columnFamilyName cf 2023-07-11 20:12:51,743 INFO [StoreOpener-2d76a6751de3c704f81063615c42b854-1] regionserver.HStore(310): Store=2d76a6751de3c704f81063615c42b854/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:51,746 INFO [StoreOpener-64af02dd11316c366831f14bc6dd7414-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,749 DEBUG [StoreOpener-64af02dd11316c366831f14bc6dd7414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf 2023-07-11 20:12:51,749 DEBUG [StoreOpener-64af02dd11316c366831f14bc6dd7414-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf 2023-07-11 20:12:51,749 INFO [StoreOpener-64af02dd11316c366831f14bc6dd7414-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64af02dd11316c366831f14bc6dd7414 columnFamilyName cf 2023-07-11 20:12:51,750 INFO [StoreOpener-64af02dd11316c366831f14bc6dd7414-1] regionserver.HStore(310): Store=64af02dd11316c366831f14bc6dd7414/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:51,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d76a6751de3c704f81063615c42b854 2023-07-11 20:12:51,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:12:51,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:51,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d76a6751de3c704f81063615c42b854; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66408481, jitterRate=-0.010436519980430603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:51,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d76a6751de3c704f81063615c42b854: 2023-07-11 20:12:51,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854., pid=15, masterSystemTime=1689106371728 2023-07-11 20:12:51,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:51,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2d76a6751de3c704f81063615c42b854, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:51,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106371768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106371768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106371768"}]},"ts":"1689106371768"} 2023-07-11 20:12:51,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:51,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 64af02dd11316c366831f14bc6dd7414; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67195375, jitterRate=0.0012891143560409546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:51,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 64af02dd11316c366831f14bc6dd7414: 2023-07-11 20:12:51,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414., pid=16, masterSystemTime=1689106371730 2023-07-11 20:12:51,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:51,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-11 20:12:51,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2d76a6751de3c704f81063615c42b854, server=jenkins-hbase4.apache.org,35437,1689106361799 in 197 msec 2023-07-11 20:12:51,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=64af02dd11316c366831f14bc6dd7414, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:51,798 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106371797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106371797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106371797"}]},"ts":"1689106371797"} 2023-07-11 20:12:51,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, ASSIGN in 382 msec 2023-07-11 20:12:51,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-11 20:12:51,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 64af02dd11316c366831f14bc6dd7414, server=jenkins-hbase4.apache.org,46545,1689106361876 in 225 msec 2023-07-11 20:12:51,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 20:12:51,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, ASSIGN in 391 msec 2023-07-11 20:12:51,813 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:51,813 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106371813"}]},"ts":"1689106371813"} 2023-07-11 20:12:51,816 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-11 20:12:51,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:51,826 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-11 20:12:51,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,840 DEBUG [hconnection-0x1658aad6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:51,844 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-11 20:12:51,853 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:51,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:51,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,897 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:12:51,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 700 msec 2023-07-11 20:12:52,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:52,332 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-11 20:12:52,333 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-11 20:12:52,334 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:52,339 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-11 20:12:52,340 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:52,341 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-11 20:12:52,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106372357 (current time:1689106372357). 2023-07-11 20:12:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:12:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x27e232c6 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:52,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb0777b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:52,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,370 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27e232c6 to 127.0.0.1:50019 2023-07-11 20:12:52,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:52,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x49b6bc44 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:52,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@617706de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:52,380 DEBUG [hconnection-0x7345d3dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,381 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,387 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49b6bc44 to 127.0.0.1:50019 2023-07-11 20:12:52,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:52,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:52,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:12:52,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,439 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,441 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689106972441 2023-07-11 20:12:52,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 20:12:52,447 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:52,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-11 20:12:52,451 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:52,451 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:12:52,451 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:12:52,452 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689106972452 2023-07-11 20:12:52,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,506 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-11 20:12:52,506 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,510 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 20:12:52,510 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 20:12:52,511 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,511 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,516 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,516 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,517 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,522 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,524 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,529 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,530 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,530 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,530 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,530 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,531 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703b0e13[Count = 1] remaining members to acquire global barrier 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:52,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703b0e13[Count = 0] remaining members to acquire global barrier 2023-07-11 20:12:52,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 20:12:52,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,541 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,542 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:12:52,542 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,542 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:52,543 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:52,544 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:52,544 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. started... 2023-07-11 20:12:52,544 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. started... 2023-07-11 20:12:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,549 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:52,551 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:52,551 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d76a6751de3c704f81063615c42b854: 2023-07-11 20:12:52,551 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64af02dd11316c366831f14bc6dd7414: 2023-07-11 20:12:52,553 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,553 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:52,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:52,557 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:12:52,559 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:52,559 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:52,564 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:12:52,564 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:12:52,603 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. completed. 2023-07-11 20:12:52,603 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:52,609 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. completed. 2023-07-11 20:12:52,609 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:52,609 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:12:52,610 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:12:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:52,612 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,614 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,614 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,614 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:12:52,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 20:12:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:12:52,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 20:12:52,627 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-11 20:12:52,627 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:12:52,627 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:12:52,627 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,627 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:12:52,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,632 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,636 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,637 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,637 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,641 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,641 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,643 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,667 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,666 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:52,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,667 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:52,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,757 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:52,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:52,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:52,759 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:12:52,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 20:12:52,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,817 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689106372441Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689106372668 (+227 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689106372668Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689106372684 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689106372708 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689106372816 (+108 ms) 2023-07-11 20:12:52,819 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:52,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 375 msec 2023-07-11 20:12:53,060 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:12:53,087 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,093 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:12:53,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35437] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:12:53,102 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 20:12:53,103 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:53,105 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:53,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106373135 (current time:1689106373135). 2023-07-11 20:12:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:12:53,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x62ad4067 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:53,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e0f38d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:53,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,146 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62ad4067 to 127.0.0.1:50019 2023-07-11 20:12:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x281ba359 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:53,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20bd7045, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:53,155 DEBUG [hconnection-0x17431d21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,158 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,165 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281ba359 to 127.0.0.1:50019 2023-07-11 20:12:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:53,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:53,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:12:53,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,172 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,174 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689106973174 2023-07-11 20:12:53,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 20:12:53,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,175 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:12:53,175 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:12:53,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,177 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-11 20:12:53,180 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,181 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689106973181 2023-07-11 20:12:53,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-11 20:12:53,206 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-11 20:12:53,206 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,207 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 20:12:53,207 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 20:12:53,208 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,208 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,210 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,210 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,210 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,211 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,211 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:12:53,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,213 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,219 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,220 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b7dec3[Count = 1] remaining members to acquire global barrier 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:53,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b7dec3[Count = 0] remaining members to acquire global barrier 2023-07-11 20:12:53,227 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 20:12:53,227 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:53,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:53,233 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:53,234 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:53,234 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:53,234 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. started... 2023-07-11 20:12:53,234 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,234 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:53,234 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:12:53,234 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. started... 2023-07-11 20:12:53,234 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:12:53,234 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 64af02dd11316c366831f14bc6dd7414 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 20:12:53,234 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:53,234 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d76a6751de3c704f81063615c42b854 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 20:12:53,237 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:53,237 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,237 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:53,276 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:53,278 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:12:53,374 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/.tmp/cf/97200406f12241bbbd734b5718f01639 2023-07-11 20:12:53,432 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/.tmp/cf/97200406f12241bbbd734b5718f01639 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639 2023-07-11 20:12:53,441 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639, entries=46, sequenceid=6, filesize=7.9 K 2023-07-11 20:12:53,443 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2d76a6751de3c704f81063615c42b854 in 209ms, sequenceid=6, compaction requested=false 2023-07-11 20:12:53,443 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-11 20:12:53,444 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d76a6751de3c704f81063615c42b854: 2023-07-11 20:12:53,444 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:53,444 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:53,445 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639] hfiles 2023-07-11 20:12:53,445 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:53,461 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. completed. 2023-07-11 20:12:53,462 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:12:53,462 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:53,462 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:53,462 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,462 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:53,462 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:12:53,464 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,464 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,464 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,465 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:12:53,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 20:12:53,478 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:53,480 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:12:53,780 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:53,782 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:12:53,786 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/.tmp/cf/7ffca313ca894ed6aa4ab435abe593aa 2023-07-11 20:12:53,796 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/.tmp/cf/7ffca313ca894ed6aa4ab435abe593aa as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa 2023-07-11 20:12:53,805 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa, entries=4, sequenceid=6, filesize=5.1 K 2023-07-11 20:12:53,808 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 64af02dd11316c366831f14bc6dd7414 in 574ms, sequenceid=6, compaction requested=false 2023-07-11 20:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64af02dd11316c366831f14bc6dd7414: 2023-07-11 20:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa] hfiles 2023-07-11 20:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:53,825 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. completed. 2023-07-11 20:12:53,825 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:12:53,825 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:53,826 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:53,826 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,826 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:53,826 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:12:53,828 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,828 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,828 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,828 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:12:53,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 20:12:53,833 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-11 20:12:53,834 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:12:53,834 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:12:53,834 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,834 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,836 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,837 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,838 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,840 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,840 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,840 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,852 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-11 20:12:53,852 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-11 20:12:53,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:12:53,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 20:12:53,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,958 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689106373174Consolidate snapshot: snaptb0-testExportWithTargetName at 1689106373853 (+679 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689106373853Writing data manifest for snaptb0-testExportWithTargetName at 1689106373863 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689106373888 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689106373957 (+69 ms) 2023-07-11 20:12:53,960 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 785 msec 2023-07-11 20:12:54,282 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:54,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:54,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:12:54,286 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286 2023-07-11 20:12:54,286 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36637, tgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286, rawTgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:54,327 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:12:54,327 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1411951320_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 20:12:54,327 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-11 20:12:54,344 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 20:12:54,418 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,419 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,419 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,420 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,420 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,421 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,421 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,495 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-5116683192574550608.jar 2023-07-11 20:12:54,496 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,496 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,498 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,498 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:54,499 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:12:54,500 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:12:54,500 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:12:54,501 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:12:54,502 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:12:54,504 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:12:54,504 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:12:54,505 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:12:54,505 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:12:54,505 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:12:54,509 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:54,509 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:54,509 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:54,510 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:54,510 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:54,511 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:54,511 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:55,802 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:12:55,810 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-11 20:12:55,823 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 20:12:56,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:12:56,435 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:12:56,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0001_000001 (auth:SIMPLE) 2023-07-11 20:12:57,249 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:02,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:04,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:08,875 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:08,880 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:08,896 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-11 20:13:08,897 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:08,898 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:08,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 20:13:08,899 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-11 20:13:08,899 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-11 20:13:08,899 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/testExportWithTargetName 2023-07-11 20:13:08,900 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-11 20:13:08,900 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106374286/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-11 20:13:08,913 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-11 20:13:08,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-11 20:13:08,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:08,931 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106388931"}]},"ts":"1689106388931"} 2023-07-11 20:13:08,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:08,933 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-11 20:13:08,935 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-11 20:13:08,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, UNASSIGN}] 2023-07-11 20:13:08,939 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, UNASSIGN 2023-07-11 20:13:08,940 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, UNASSIGN 2023-07-11 20:13:08,941 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=64af02dd11316c366831f14bc6dd7414, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:08,941 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2d76a6751de3c704f81063615c42b854, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:08,941 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106388941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106388941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106388941"}]},"ts":"1689106388941"} 2023-07-11 20:13:08,941 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106388941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106388941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106388941"}]},"ts":"1689106388941"} 2023-07-11 20:13:08,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 64af02dd11316c366831f14bc6dd7414, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:08,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 2d76a6751de3c704f81063615c42b854, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:13:09,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:09,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:13:09,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d76a6751de3c704f81063615c42b854 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 64af02dd11316c366831f14bc6dd7414, disabling compactions & flushes 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d76a6751de3c704f81063615c42b854, disabling compactions & flushes 2023-07-11 20:13:09,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:13:09,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. after waiting 0 ms 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. after waiting 0 ms 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:13:09,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:13:09,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:09,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:09,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:09,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:09,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414. 2023-07-11 20:13:09,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854. 2023-07-11 20:13:09,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 64af02dd11316c366831f14bc6dd7414: 2023-07-11 20:13:09,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d76a6751de3c704f81063615c42b854: 2023-07-11 20:13:09,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 64af02dd11316c366831f14bc6dd7414 2023-07-11 20:13:09,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=64af02dd11316c366831f14bc6dd7414, regionState=CLOSED 2023-07-11 20:13:09,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d76a6751de3c704f81063615c42b854 2023-07-11 20:13:09,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106389126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106389126"}]},"ts":"1689106389126"} 2023-07-11 20:13:09,127 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2d76a6751de3c704f81063615c42b854, regionState=CLOSED 2023-07-11 20:13:09,127 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106389127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106389127"}]},"ts":"1689106389127"} 2023-07-11 20:13:09,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-11 20:13:09,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 64af02dd11316c366831f14bc6dd7414, server=jenkins-hbase4.apache.org,46545,1689106361876 in 185 msec 2023-07-11 20:13:09,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-11 20:13:09,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 2d76a6751de3c704f81063615c42b854, server=jenkins-hbase4.apache.org,35437,1689106361799 in 186 msec 2023-07-11 20:13:09,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=64af02dd11316c366831f14bc6dd7414, UNASSIGN in 198 msec 2023-07-11 20:13:09,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-11 20:13:09,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2d76a6751de3c704f81063615c42b854, UNASSIGN in 200 msec 2023-07-11 20:13:09,140 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106389140"}]},"ts":"1689106389140"} 2023-07-11 20:13:09,142 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-11 20:13:09,144 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-11 20:13:09,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-07-11 20:13:09,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:09,235 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-11 20:13:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-11 20:13:09,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-11 20:13:09,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,255 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-11 20:13:09,259 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:09,259 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:09,259 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:09,259 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:09,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-11 20:13:09,261 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:09,261 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,261 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,261 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,261 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,262 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:13:09,262 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:13:09,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:09,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:09,263 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:09,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:09,263 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:09,263 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:09,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 20:13:09,266 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/recovered.edits] 2023-07-11 20:13:09,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/recovered.edits] 2023-07-11 20:13:09,274 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/cf/97200406f12241bbbd734b5718f01639 2023-07-11 20:13:09,274 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/cf/7ffca313ca894ed6aa4ab435abe593aa 2023-07-11 20:13:09,278 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854/recovered.edits/9.seqid 2023-07-11 20:13:09,278 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414/recovered.edits/9.seqid 2023-07-11 20:13:09,279 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/2d76a6751de3c704f81063615c42b854 2023-07-11 20:13:09,279 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportWithTargetName/64af02dd11316c366831f14bc6dd7414 2023-07-11 20:13:09,279 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 20:13:09,281 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,304 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-11 20:13:09,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-11 20:13:09,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-11 20:13:09,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106389309"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:09,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106389309"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:09,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:13:09,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 64af02dd11316c366831f14bc6dd7414, NAME => 'testtb-testExportWithTargetName,,1689106371196.64af02dd11316c366831f14bc6dd7414.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d76a6751de3c704f81063615c42b854, NAME => 'testtb-testExportWithTargetName,1,1689106371196.2d76a6751de3c704f81063615c42b854.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:13:09,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-11 20:13:09,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106389311"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:09,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-11 20:13:09,316 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:09,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 74 msec 2023-07-11 20:13:09,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 20:13:09,366 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-11 20:13:09,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-11 20:13:09,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-11 20:13:09,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-11 20:13:09,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-11 20:13:09,421 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=752 (was 707) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:45190 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:43932 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1541369657_1 at /127.0.0.1:51918 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:38021 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:38579 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2002 (was 3688) 2023-07-11 20:13:09,421 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 20:13:09,442 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=180, AvailableMemoryMB=2002 2023-07-11 20:13:09,442 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 20:13:09,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:13:09,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:09,449 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:13:09,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-11 20:13:09,450 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:13:09,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:09,452 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,452 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,453 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def empty. 2023-07-11 20:13:09,453 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 empty. 2023-07-11 20:13:09,454 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,454 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,454 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 20:13:09,468 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 20:13:09,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c5e0bb0fad5f0cfad620531c91d7def, NAME => 'testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:09,469 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 743ad347de794b278ac797e15313ab55, NAME => 'testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:09,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:09,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:09,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 743ad347de794b278ac797e15313ab55, disabling compactions & flushes 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4c5e0bb0fad5f0cfad620531c91d7def, disabling compactions & flushes 2023-07-11 20:13:09,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. after waiting 0 ms 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. after waiting 0 ms 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,500 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 743ad347de794b278ac797e15313ab55: 2023-07-11 20:13:09,501 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4c5e0bb0fad5f0cfad620531c91d7def: 2023-07-11 20:13:09,505 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:13:09,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106389507"}]},"ts":"1689106389507"} 2023-07-11 20:13:09,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106389507"}]},"ts":"1689106389507"} 2023-07-11 20:13:09,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:13:09,511 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:13:09,512 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106389512"}]},"ts":"1689106389512"} 2023-07-11 20:13:09,513 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 20:13:09,518 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:13:09,520 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:13:09,520 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:13:09,520 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:13:09,520 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:13:09,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, ASSIGN}] 2023-07-11 20:13:09,523 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, ASSIGN 2023-07-11 20:13:09,523 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, ASSIGN 2023-07-11 20:13:09,525 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:13:09,525 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:13:09,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:09,675 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:13:09,678 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4c5e0bb0fad5f0cfad620531c91d7def, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:09,678 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=743ad347de794b278ac797e15313ab55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:09,678 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389677"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106389677"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106389677"}]},"ts":"1689106389677"} 2023-07-11 20:13:09,678 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389678"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106389678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106389678"}]},"ts":"1689106389678"} 2023-07-11 20:13:09,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 4c5e0bb0fad5f0cfad620531c91d7def, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:09,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 743ad347de794b278ac797e15313ab55, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:13:09,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:09,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c5e0bb0fad5f0cfad620531c91d7def, NAME => 'testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:13:09,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. service=AccessControlService 2023-07-11 20:13:09,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 743ad347de794b278ac797e15313ab55, NAME => 'testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:13:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. service=AccessControlService 2023-07-11 20:13:09,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,847 INFO [StoreOpener-4c5e0bb0fad5f0cfad620531c91d7def-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,847 INFO [StoreOpener-743ad347de794b278ac797e15313ab55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,848 DEBUG [StoreOpener-4c5e0bb0fad5f0cfad620531c91d7def-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf 2023-07-11 20:13:09,849 DEBUG [StoreOpener-4c5e0bb0fad5f0cfad620531c91d7def-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf 2023-07-11 20:13:09,849 INFO [StoreOpener-4c5e0bb0fad5f0cfad620531c91d7def-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c5e0bb0fad5f0cfad620531c91d7def columnFamilyName cf 2023-07-11 20:13:09,849 DEBUG [StoreOpener-743ad347de794b278ac797e15313ab55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf 2023-07-11 20:13:09,849 DEBUG [StoreOpener-743ad347de794b278ac797e15313ab55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf 2023-07-11 20:13:09,850 INFO [StoreOpener-743ad347de794b278ac797e15313ab55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 743ad347de794b278ac797e15313ab55 columnFamilyName cf 2023-07-11 20:13:09,850 INFO [StoreOpener-4c5e0bb0fad5f0cfad620531c91d7def-1] regionserver.HStore(310): Store=4c5e0bb0fad5f0cfad620531c91d7def/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:09,852 INFO [StoreOpener-743ad347de794b278ac797e15313ab55-1] regionserver.HStore(310): Store=743ad347de794b278ac797e15313ab55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:09,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:09,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:09,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:09,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:09,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c5e0bb0fad5f0cfad620531c91d7def; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71791972, jitterRate=0.06978374719619751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:09,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 743ad347de794b278ac797e15313ab55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62802197, jitterRate=-0.0641743391752243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:09,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c5e0bb0fad5f0cfad620531c91d7def: 2023-07-11 20:13:09,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 743ad347de794b278ac797e15313ab55: 2023-07-11 20:13:09,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55., pid=31, masterSystemTime=1689106389834 2023-07-11 20:13:09,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def., pid=30, masterSystemTime=1689106389832 2023-07-11 20:13:09,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:09,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=743ad347de794b278ac797e15313ab55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:09,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:09,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106389873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106389873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106389873"}]},"ts":"1689106389873"} 2023-07-11 20:13:09,874 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4c5e0bb0fad5f0cfad620531c91d7def, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:09,874 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106389874"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106389874"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106389874"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106389874"}]},"ts":"1689106389874"} 2023-07-11 20:13:09,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-11 20:13:09,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 743ad347de794b278ac797e15313ab55, server=jenkins-hbase4.apache.org,41061,1689106361927 in 194 msec 2023-07-11 20:13:09,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-11 20:13:09,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 4c5e0bb0fad5f0cfad620531c91d7def, server=jenkins-hbase4.apache.org,46545,1689106361876 in 198 msec 2023-07-11 20:13:09,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, ASSIGN in 361 msec 2023-07-11 20:13:09,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 20:13:09,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, ASSIGN in 364 msec 2023-07-11 20:13:09,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:13:09,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106389893"}]},"ts":"1689106389893"} 2023-07-11 20:13:09,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 20:13:09,898 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:13:09,898 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-11 20:13:09,900 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:09,902 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,902 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,902 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,903 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:09,906 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:09,906 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:09,906 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:09,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:09,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:09,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:09,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:09,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 461 msec 2023-07-11 20:13:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:10,053 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-11 20:13:10,054 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-11 20:13:10,054 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:10,058 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-11 20:13:10,058 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:10,058 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-11 20:13:10,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106390062 (current time:1689106390062). 2023-07-11 20:13:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x6e4572e9 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:10,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6788794d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:10,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,073 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e4572e9 to 127.0.0.1:50019 2023-07-11 20:13:10,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:10,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x5b02df92 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:10,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e153c21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:10,090 DEBUG [hconnection-0x3af37cbf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,092 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,099 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b02df92 to 127.0.0.1:50019 2023-07-11 20:13:10,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:10,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:10,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:10,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,105 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,107 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689106990107 2023-07-11 20:13:10,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 20:13:10,108 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:10,108 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:10,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,109 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-11 20:13:10,112 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,113 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689106990113 2023-07-11 20:13:10,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,127 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-11 20:13:10,127 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 20:13:10,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:13:10,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,131 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,131 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,131 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,132 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,132 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,132 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,133 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,133 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,133 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,133 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,134 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,134 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,135 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,137 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,137 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,142 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@410d0c44[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:10,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@410d0c44[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:10,149 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:13:10,150 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,151 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,152 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:13:10,152 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:10,152 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:10,152 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:10,152 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. started... 2023-07-11 20:13:10,152 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,152 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 743ad347de794b278ac797e15313ab55: 2023-07-11 20:13:10,154 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:10,154 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. started... 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:10,154 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:10,155 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c5e0bb0fad5f0cfad620531c91d7def: 2023-07-11 20:13:10,155 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,156 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:10,156 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:10,159 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,159 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,159 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:10,159 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,159 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,183 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. completed. 2023-07-11 20:13:10,183 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,183 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,185 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,188 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. completed. 2023-07-11 20:13:10,188 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,188 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,191 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:10,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:13:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:13:10,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:13:10,200 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-11 20:13:10,200 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:10,200 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:10,200 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,200 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:10,202 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,203 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,202 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,203 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,203 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,204 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,207 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,208 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,208 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,208 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:10,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:10,210 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,213 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,212 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,215 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,216 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 20:13:10,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,269 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:10,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689106390107Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689106390213 (+106 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689106390215 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689106390219 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689106390234 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689106390268 (+34 ms) 2023-07-11 20:13:10,272 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 164 msec 2023-07-11 20:13:10,410 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:10,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:10,423 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,426 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41061] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:10,434 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 20:13:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:10,435 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:10,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106390458 (current time:1689106390458). 2023-07-11 20:13:10,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:10,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x4a527134 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:10,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77cab38d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:10,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,473 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a527134 to 127.0.0.1:50019 2023-07-11 20:13:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x5e7c62f3 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@258aee70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:10,490 DEBUG [hconnection-0x4b47d0fb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,491 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:10,500 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:10,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e7c62f3 to 127.0.0.1:50019 2023-07-11 20:13:10,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:10,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:10,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:10,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,513 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,514 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689106990514 2023-07-11 20:13:10,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 20:13:10,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:10,517 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:10,517 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:10,519 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:10,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-11 20:13:10,521 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,522 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689106990522 2023-07-11 20:13:10,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-11 20:13:10,537 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-11 20:13:10,537 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 20:13:10,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:13:10,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,539 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,540 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,540 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,540 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,540 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,541 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,541 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,541 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,541 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,543 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,542 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:10,545 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,545 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,545 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,546 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,545 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:10,546 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,546 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:10,547 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,547 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,547 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,547 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,548 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d57b41d[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:10,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d57b41d[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:10,552 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:13:10,552 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,554 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,554 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,554 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,555 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,555 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,555 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:10,555 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:10,555 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,555 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,556 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,556 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:10,556 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:10,555 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:10,556 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:10,556 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:10,556 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. started... 2023-07-11 20:13:10,556 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,556 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. started... 2023-07-11 20:13:10,556 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:13:10,556 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4c5e0bb0fad5f0cfad620531c91d7def 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 20:13:10,556 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 743ad347de794b278ac797e15313ab55 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 20:13:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,558 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,570 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/.tmp/cf/0f005445f1eb4ee8bcc02fcf4056f021 2023-07-11 20:13:10,573 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/.tmp/cf/d14c05b737d9437cbb4f6e3576b2ea2c 2023-07-11 20:13:10,580 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/.tmp/cf/0f005445f1eb4ee8bcc02fcf4056f021 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021 2023-07-11 20:13:10,583 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/.tmp/cf/d14c05b737d9437cbb4f6e3576b2ea2c as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c 2023-07-11 20:13:10,587 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021, entries=2, sequenceid=6, filesize=5.0 K 2023-07-11 20:13:10,589 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4c5e0bb0fad5f0cfad620531c91d7def in 33ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:10,589 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 20:13:10,590 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c5e0bb0fad5f0cfad620531c91d7def: 2023-07-11 20:13:10,590 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:10,590 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:10,590 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021] hfiles 2023-07-11 20:13:10,590 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:10,592 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c, entries=48, sequenceid=6, filesize=8.1 K 2023-07-11 20:13:10,594 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 743ad347de794b278ac797e15313ab55 in 38ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:10,595 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 743ad347de794b278ac797e15313ab55: 2023-07-11 20:13:10,595 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:10,595 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:10,596 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c] hfiles 2023-07-11 20:13:10,596 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:10,610 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. completed. 2023-07-11 20:13:10,611 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:10,611 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:10,611 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:10,611 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,611 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,611 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:10,615 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. completed. 2023-07-11 20:13:10,615 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:10,615 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:10,615 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:10,615 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,615 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:10,615 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:10,617 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:10,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:10,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:10,618 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,618 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,618 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,619 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,620 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,620 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,621 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,621 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:10,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:13:10,629 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-11 20:13:10,629 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:10,629 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:10,629 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-11 20:13:10,629 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:10,630 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:10,632 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,632 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,635 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,635 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:10,635 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,639 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,639 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,639 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,639 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:10,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:10,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:10,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,639 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:10,639 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:10,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:10,640 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:10,641 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,641 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:10,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:10,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 20:13:10,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,715 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689106390515Consolidate snapshot: snaptb0-testExportFileSystemState at 1689106390640 (+125 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689106390640Writing data manifest for snaptb0-testExportFileSystemState at 1689106390646 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689106390655 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689106390715 (+60 ms) 2023-07-11 20:13:10,718 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:10,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 201 msec 2023-07-11 20:13:10,820 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:10,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:10,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:10,824 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824 2023-07-11 20:13:10,824 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36637, tgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824, rawTgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:10,855 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:10,856 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1049091444_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,856 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-11 20:13:10,904 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:10,954 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,955 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,955 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,955 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,956 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,956 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:10,956 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,032 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-6137025988064793550.jar 2023-07-11 20:13:11,033 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,033 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,034 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,034 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,035 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,035 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:11,035 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:11,036 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:11,036 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:11,037 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:11,037 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:11,038 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:11,038 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:11,039 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:11,039 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:11,040 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:11,041 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:11,041 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:11,042 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:11,042 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:11,043 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:11,043 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:11,044 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:11,992 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:11,995 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-11 20:13:11,997 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 20:13:13,439 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:13,443 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:13,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:14,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:14,713 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:18,641 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:20,866 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:23,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:25,226 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:25,227 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:25,235 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-11 20:13:25,235 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:25,235 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:25,236 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:25,236 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 20:13:25,236 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 20:13:25,236 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:25,237 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 20:13:25,237 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106390824/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 20:13:25,244 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-11 20:13:25,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-11 20:13:25,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:25,249 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106405249"}]},"ts":"1689106405249"} 2023-07-11 20:13:25,251 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 20:13:25,253 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-11 20:13:25,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, UNASSIGN}] 2023-07-11 20:13:25,256 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, UNASSIGN 2023-07-11 20:13:25,256 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, UNASSIGN 2023-07-11 20:13:25,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=743ad347de794b278ac797e15313ab55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:25,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4c5e0bb0fad5f0cfad620531c91d7def, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:25,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106405256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106405256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106405256"}]},"ts":"1689106405256"} 2023-07-11 20:13:25,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106405256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106405256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106405256"}]},"ts":"1689106405256"} 2023-07-11 20:13:25,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 743ad347de794b278ac797e15313ab55, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:13:25,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 4c5e0bb0fad5f0cfad620531c91d7def, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:25,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:25,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:25,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 743ad347de794b278ac797e15313ab55, disabling compactions & flushes 2023-07-11 20:13:25,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:25,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:25,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. after waiting 0 ms 2023-07-11 20:13:25,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:25,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:25,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c5e0bb0fad5f0cfad620531c91d7def, disabling compactions & flushes 2023-07-11 20:13:25,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:25,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:25,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. after waiting 0 ms 2023-07-11 20:13:25,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:25,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:25,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:25,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55. 2023-07-11 20:13:25,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:25,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 743ad347de794b278ac797e15313ab55: 2023-07-11 20:13:25,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def. 2023-07-11 20:13:25,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c5e0bb0fad5f0cfad620531c91d7def: 2023-07-11 20:13:25,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 743ad347de794b278ac797e15313ab55 2023-07-11 20:13:25,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=743ad347de794b278ac797e15313ab55, regionState=CLOSED 2023-07-11 20:13:25,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106405432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106405432"}]},"ts":"1689106405432"} 2023-07-11 20:13:25,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:25,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4c5e0bb0fad5f0cfad620531c91d7def, regionState=CLOSED 2023-07-11 20:13:25,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106405433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106405433"}]},"ts":"1689106405433"} 2023-07-11 20:13:25,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-11 20:13:25,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 743ad347de794b278ac797e15313ab55, server=jenkins-hbase4.apache.org,41061,1689106361927 in 176 msec 2023-07-11 20:13:25,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-11 20:13:25,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 4c5e0bb0fad5f0cfad620531c91d7def, server=jenkins-hbase4.apache.org,46545,1689106361876 in 176 msec 2023-07-11 20:13:25,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=743ad347de794b278ac797e15313ab55, UNASSIGN in 183 msec 2023-07-11 20:13:25,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-11 20:13:25,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4c5e0bb0fad5f0cfad620531c91d7def, UNASSIGN in 184 msec 2023-07-11 20:13:25,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106405440"}]},"ts":"1689106405440"} 2023-07-11 20:13:25,441 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 20:13:25,443 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-11 20:13:25,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-11 20:13:25,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:25,551 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-11 20:13:25,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-11 20:13:25,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,555 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-11 20:13:25,556 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,558 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-11 20:13:25,561 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,561 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,561 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,561 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:25,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:25,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:25,562 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:25,562 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,562 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:25,562 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:25,562 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:25,563 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 20:13:25,565 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/recovered.edits] 2023-07-11 20:13:25,566 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/recovered.edits] 2023-07-11 20:13:25,570 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/cf/0f005445f1eb4ee8bcc02fcf4056f021 2023-07-11 20:13:25,571 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/cf/d14c05b737d9437cbb4f6e3576b2ea2c 2023-07-11 20:13:25,574 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def/recovered.edits/9.seqid 2023-07-11 20:13:25,575 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/4c5e0bb0fad5f0cfad620531c91d7def 2023-07-11 20:13:25,575 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55/recovered.edits/9.seqid 2023-07-11 20:13:25,575 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemState/743ad347de794b278ac797e15313ab55 2023-07-11 20:13:25,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 20:13:25,578 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,581 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-11 20:13:25,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-11 20:13:25,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-11 20:13:25,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106405584"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:25,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106405584"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:25,586 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:13:25,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4c5e0bb0fad5f0cfad620531c91d7def, NAME => 'testtb-testExportFileSystemState,,1689106389443.4c5e0bb0fad5f0cfad620531c91d7def.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 743ad347de794b278ac797e15313ab55, NAME => 'testtb-testExportFileSystemState,1,1689106389443.743ad347de794b278ac797e15313ab55.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:13:25,586 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-11 20:13:25,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106405586"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:25,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-11 20:13:25,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:25,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-07-11 20:13:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 20:13:25,665 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-11 20:13:25,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-11 20:13:25,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:25,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-11 20:13:25,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-11 20:13:25,708 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 752) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1776864195_1 at /127.0.0.1:44430 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1776864195_1 at /127.0.0.1:37932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:47148 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:42091 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:37972 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:44448 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=479 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=1648 (was 2002) 2023-07-11 20:13:25,708 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-11 20:13:25,729 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=479, ProcessCount=180, AvailableMemoryMB=1648 2023-07-11 20:13:25,730 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-11 20:13:25,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:13:25,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:25,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:13:25,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-11 20:13:25,737 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:13:25,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:25,740 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:25,740 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:25,740 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 empty. 2023-07-11 20:13:25,741 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb empty. 2023-07-11 20:13:25,741 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:25,741 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:25,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 20:13:25,753 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-11 20:13:25,755 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91d0fd34c84de8bc9f83b4c93cff8061, NAME => 'testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:25,758 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5b825432e4cdff2abec2bbda6e8c4beb, NAME => 'testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 91d0fd34c84de8bc9f83b4c93cff8061, disabling compactions & flushes 2023-07-11 20:13:25,774 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. after waiting 0 ms 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:25,774 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 91d0fd34c84de8bc9f83b4c93cff8061: 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5b825432e4cdff2abec2bbda6e8c4beb, disabling compactions & flushes 2023-07-11 20:13:25,774 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:25,774 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:25,775 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. after waiting 0 ms 2023-07-11 20:13:25,775 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:25,775 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:25,775 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5b825432e4cdff2abec2bbda6e8c4beb: 2023-07-11 20:13:25,778 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:13:25,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106405779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106405779"}]},"ts":"1689106405779"} 2023-07-11 20:13:25,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106405779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106405779"}]},"ts":"1689106405779"} 2023-07-11 20:13:25,781 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:13:25,782 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:13:25,782 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106405782"}]},"ts":"1689106405782"} 2023-07-11 20:13:25,784 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-11 20:13:25,787 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:13:25,788 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:13:25,788 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:13:25,788 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:13:25,788 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:13:25,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, ASSIGN}] 2023-07-11 20:13:25,791 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, ASSIGN 2023-07-11 20:13:25,792 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, ASSIGN 2023-07-11 20:13:25,792 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:13:25,792 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:13:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:25,943 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:13:25,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=91d0fd34c84de8bc9f83b4c93cff8061, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:25,945 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5b825432e4cdff2abec2bbda6e8c4beb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:25,946 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106405945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106405945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106405945"}]},"ts":"1689106405945"} 2023-07-11 20:13:25,946 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106405945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106405945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106405945"}]},"ts":"1689106405945"} 2023-07-11 20:13:25,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 91d0fd34c84de8bc9f83b4c93cff8061, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:13:25,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 5b825432e4cdff2abec2bbda6e8c4beb, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:26,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:26,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b825432e4cdff2abec2bbda6e8c4beb, NAME => 'testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:13:26,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. service=AccessControlService 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91d0fd34c84de8bc9f83b4c93cff8061, NAME => 'testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:13:26,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. service=AccessControlService 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:26,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:26,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,105 INFO [StoreOpener-5b825432e4cdff2abec2bbda6e8c4beb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,106 INFO [StoreOpener-91d0fd34c84de8bc9f83b4c93cff8061-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,107 DEBUG [StoreOpener-5b825432e4cdff2abec2bbda6e8c4beb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf 2023-07-11 20:13:26,107 DEBUG [StoreOpener-5b825432e4cdff2abec2bbda6e8c4beb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf 2023-07-11 20:13:26,107 INFO [StoreOpener-5b825432e4cdff2abec2bbda6e8c4beb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b825432e4cdff2abec2bbda6e8c4beb columnFamilyName cf 2023-07-11 20:13:26,107 DEBUG [StoreOpener-91d0fd34c84de8bc9f83b4c93cff8061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf 2023-07-11 20:13:26,107 DEBUG [StoreOpener-91d0fd34c84de8bc9f83b4c93cff8061-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf 2023-07-11 20:13:26,108 INFO [StoreOpener-91d0fd34c84de8bc9f83b4c93cff8061-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91d0fd34c84de8bc9f83b4c93cff8061 columnFamilyName cf 2023-07-11 20:13:26,108 INFO [StoreOpener-5b825432e4cdff2abec2bbda6e8c4beb-1] regionserver.HStore(310): Store=5b825432e4cdff2abec2bbda6e8c4beb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:26,108 INFO [StoreOpener-91d0fd34c84de8bc9f83b4c93cff8061-1] regionserver.HStore(310): Store=91d0fd34c84de8bc9f83b4c93cff8061/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:26,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:26,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:26,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:26,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:26,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91d0fd34c84de8bc9f83b4c93cff8061; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74265254, jitterRate=0.10663852095603943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:26,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b825432e4cdff2abec2bbda6e8c4beb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69576648, jitterRate=0.036772847175598145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:26,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91d0fd34c84de8bc9f83b4c93cff8061: 2023-07-11 20:13:26,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b825432e4cdff2abec2bbda6e8c4beb: 2023-07-11 20:13:26,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb., pid=46, masterSystemTime=1689106406100 2023-07-11 20:13:26,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061., pid=45, masterSystemTime=1689106406099 2023-07-11 20:13:26,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5b825432e4cdff2abec2bbda6e8c4beb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,119 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106406118"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106406118"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106406118"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106406118"}]},"ts":"1689106406118"} 2023-07-11 20:13:26,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=91d0fd34c84de8bc9f83b4c93cff8061, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106406119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106406119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106406119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106406119"}]},"ts":"1689106406119"} 2023-07-11 20:13:26,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-11 20:13:26,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 5b825432e4cdff2abec2bbda6e8c4beb, server=jenkins-hbase4.apache.org,46545,1689106361876 in 173 msec 2023-07-11 20:13:26,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-11 20:13:26,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 91d0fd34c84de8bc9f83b4c93cff8061, server=jenkins-hbase4.apache.org,41061,1689106361927 in 174 msec 2023-07-11 20:13:26,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, ASSIGN in 334 msec 2023-07-11 20:13:26,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-11 20:13:26,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, ASSIGN in 335 msec 2023-07-11 20:13:26,127 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:13:26,128 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106406128"}]},"ts":"1689106406128"} 2023-07-11 20:13:26,129 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-11 20:13:26,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:13:26,132 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-11 20:13:26,134 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:26,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:26,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:26,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:26,136 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:26,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:26,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:26,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:26,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:26,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 405 msec 2023-07-11 20:13:26,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:26,341 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-11 20:13:26,341 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-11 20:13:26,341 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:26,345 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-11 20:13:26,345 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:26,345 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-11 20:13:26,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106406348 (current time:1689106406348). 2023-07-11 20:13:26,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:26,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x5807cf31 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:26,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242f5b5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:26,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5807cf31 to 127.0.0.1:50019 2023-07-11 20:13:26,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:26,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x61648b41 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:26,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77cbe1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:26,371 DEBUG [hconnection-0x59d7c82c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,374 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,380 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61648b41 to 127.0.0.1:50019 2023-07-11 20:13:26,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:26,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:26,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:26,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,385 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,386 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689107006386 2023-07-11 20:13:26,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 20:13:26,387 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:26,387 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:26,390 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-11 20:13:26,392 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,393 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689107006393 2023-07-11 20:13:26,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,407 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-11 20:13:26,407 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,408 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 20:13:26,408 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 20:13:26,409 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,409 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,411 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,411 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,411 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,411 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,412 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,412 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,413 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,413 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,415 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,415 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,415 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,415 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,415 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,416 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,419 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,419 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,419 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,419 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,420 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,421 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,421 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,421 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,422 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,422 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5347c32[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:26,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5347c32[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:26,425 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 20:13:26,426 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,427 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,427 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:26,427 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. started... 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,427 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,427 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,428 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:26,427 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. started... 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,427 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:26,429 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:26,428 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:13:26,428 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b825432e4cdff2abec2bbda6e8c4beb: 2023-07-11 20:13:26,429 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91d0fd34c84de8bc9f83b4c93cff8061: 2023-07-11 20:13:26,429 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,430 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,430 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:26,430 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:26,430 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:26,430 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,440 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,445 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. completed. 2023-07-11 20:13:26,445 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,445 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:26,445 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:26,445 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,446 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,446 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:26,447 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,447 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,447 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,447 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,451 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. completed. 2023-07-11 20:13:26,451 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:26,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,453 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:26,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 20:13:26,459 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-11 20:13:26,459 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:26,459 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:26,459 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,459 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,461 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,462 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,462 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,463 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,465 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,465 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,466 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,471 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,471 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,472 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,473 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,487 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:26,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:26,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:26,488 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:26,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 20:13:26,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,515 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:26,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689106406386Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689106406472 (+86 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689106406473 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689106406476 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689106406484 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689106406514 (+30 ms) 2023-07-11 20:13:26,518 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 131 msec 2023-07-11 20:13:26,689 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:26,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:26,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:26,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41061] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:26,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:26,705 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 20:13:26,706 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,708 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:26,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106406719 (current time:1689106406719). 2023-07-11 20:13:26,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:26,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x04605ae3 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:26,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@570eaa7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:26,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,733 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04605ae3 to 127.0.0.1:50019 2023-07-11 20:13:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x39cdfcc4 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:26,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7c0e5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:26,743 DEBUG [hconnection-0x1d03168c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,746 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:26,750 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:26,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39cdfcc4 to 127.0.0.1:50019 2023-07-11 20:13:26,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:26,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:26,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:26,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,756 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,757 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689107006757 2023-07-11 20:13:26,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:26,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 20:13:26,759 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:26,759 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:26,760 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:26,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-11 20:13:26,763 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,763 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689107006763 2023-07-11 20:13:26,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-11 20:13:26,776 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-11 20:13:26,776 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,778 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 20:13:26,778 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 20:13:26,779 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,779 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,780 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,780 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,780 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,780 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,781 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,781 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,782 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:26,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:26,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,784 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,784 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,784 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:26,785 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,785 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:26,785 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:26,784 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,785 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:26,788 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,788 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,789 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,789 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b3eb91[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:26,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b3eb91[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:26,793 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 20:13:26,793 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,795 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,796 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,796 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. started... 2023-07-11 20:13:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:13:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,795 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:26,796 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:26,796 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b825432e4cdff2abec2bbda6e8c4beb 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 20:13:26,796 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,796 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:26,797 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,797 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,797 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,804 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:26,804 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,804 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:26,804 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. started... 2023-07-11 20:13:26,804 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91d0fd34c84de8bc9f83b4c93cff8061 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 20:13:26,812 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 20:13:26,816 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/.tmp/cf/e92823fd091d4102a432a7745be99945 2023-07-11 20:13:26,817 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/.tmp/cf/0a4127e07ea04cdf9998545f95263cc7 2023-07-11 20:13:26,824 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/.tmp/cf/e92823fd091d4102a432a7745be99945 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945 2023-07-11 20:13:26,825 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/.tmp/cf/0a4127e07ea04cdf9998545f95263cc7 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7 2023-07-11 20:13:26,831 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7, entries=46, sequenceid=6, filesize=7.9 K 2023-07-11 20:13:26,831 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945, entries=4, sequenceid=6, filesize=5.1 K 2023-07-11 20:13:26,832 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 91d0fd34c84de8bc9f83b4c93cff8061 in 28ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:26,832 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5b825432e4cdff2abec2bbda6e8c4beb in 36ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:26,833 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b825432e4cdff2abec2bbda6e8c4beb: 2023-07-11 20:13:26,833 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91d0fd34c84de8bc9f83b4c93cff8061: 2023-07-11 20:13:26,833 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:26,833 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:26,833 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:26,834 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:26,834 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945] hfiles 2023-07-11 20:13:26,834 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7] hfiles 2023-07-11 20:13:26,834 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945 for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:26,834 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7 for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:26,850 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. completed. 2023-07-11 20:13:26,850 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:26,850 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:26,850 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:26,850 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,850 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,850 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:26,851 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. completed. 2023-07-11 20:13:26,851 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:26,851 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:26,852 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,852 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,852 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,852 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,854 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,854 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:26,854 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,854 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,860 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:26,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:26,862 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:13:26,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 20:13:26,865 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-11 20:13:26,865 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:26,865 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:26,865 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-11 20:13:26,865 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:26,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,868 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:26,869 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,870 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:26,870 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:26,873 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:26,873 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,874 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,884 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,885 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,886 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,886 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,888 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:26,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-11 20:13:26,887 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:26,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-11 20:13:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:26,890 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,890 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:26,890 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:26,890 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,890 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:26,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 20:13:26,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,938 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:26,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689106406757Consolidate snapshot: snaptb0-testConsecutiveExports at 1689106406890 (+133 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689106406890Writing data manifest for snaptb0-testConsecutiveExports at 1689106406899 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689106406912 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689106406937 (+25 ms) 2023-07-11 20:13:26,940 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:26,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 182 msec 2023-07-11 20:13:27,062 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:27,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:27,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:27,064 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064 2023-07-11 20:13:27,064 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:27,088 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:27,088 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@519515e3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:27,088 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 20:13:27,126 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:27,146 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,146 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,147 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,147 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,148 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,148 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,149 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,237 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-1235618610570513027.jar 2023-07-11 20:13:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,239 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,239 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,240 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,240 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:27,241 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:27,241 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:27,241 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:27,242 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:27,242 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:27,243 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:27,243 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:27,243 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:27,244 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:27,244 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:27,245 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:27,245 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:27,245 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:27,245 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:27,246 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:27,246 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:27,247 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:27,687 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:27,689 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 20:13:27,692 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 20:13:29,700 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:29,700 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:29,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:30,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:31,012 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:34,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:37,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:39,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:40,888 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:40,888 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:40,896 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 20:13:40,896 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:40,897 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:40,897 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23c05c40 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:40,899 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:40,923 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:13:40,923 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@248cd9bd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:40,923 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 20:13:40,934 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:40,949 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,949 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,950 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,950 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,951 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,951 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:40,952 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,039 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-8865954599935543433.jar 2023-07-11 20:13:41,039 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,040 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,041 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,041 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,042 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,042 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:41,043 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:41,043 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:41,045 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:41,045 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:41,046 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:41,046 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:41,047 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:41,048 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:41,048 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:41,050 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:41,050 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:41,051 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:41,051 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:41,052 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:41,052 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:41,657 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:41,660 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 20:13:41,663 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 20:13:45,770 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:45,770 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:45,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:46,714 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:50,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:52,997 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:56,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:57,990 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:57,990 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:57,993 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 20:13:57,994 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:57,994 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:57,994 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23c05c40 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:57,998 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/local-export-1689106407064/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:58,010 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-11 20:13:58,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-11 20:13:58,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:13:58,015 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106438015"}]},"ts":"1689106438015"} 2023-07-11 20:13:58,017 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-11 20:13:58,018 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-11 20:13:58,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, UNASSIGN}] 2023-07-11 20:13:58,021 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, UNASSIGN 2023-07-11 20:13:58,021 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, UNASSIGN 2023-07-11 20:13:58,022 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=91d0fd34c84de8bc9f83b4c93cff8061, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:58,022 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5b825432e4cdff2abec2bbda6e8c4beb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:58,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106438022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106438022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106438022"}]},"ts":"1689106438022"} 2023-07-11 20:13:58,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106438022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106438022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106438022"}]},"ts":"1689106438022"} 2023-07-11 20:13:58,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 91d0fd34c84de8bc9f83b4c93cff8061, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:13:58,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 5b825432e4cdff2abec2bbda6e8c4beb, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:13:58,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:58,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91d0fd34c84de8bc9f83b4c93cff8061, disabling compactions & flushes 2023-07-11 20:13:58,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:58,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:58,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. after waiting 0 ms 2023-07-11 20:13:58,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:58,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:58,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b825432e4cdff2abec2bbda6e8c4beb, disabling compactions & flushes 2023-07-11 20:13:58,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:58,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:58,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. after waiting 0 ms 2023-07-11 20:13:58,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:58,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:58,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:58,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:58,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:58,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061. 2023-07-11 20:13:58,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb. 2023-07-11 20:13:58,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91d0fd34c84de8bc9f83b4c93cff8061: 2023-07-11 20:13:58,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b825432e4cdff2abec2bbda6e8c4beb: 2023-07-11 20:13:58,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:58,200 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=91d0fd34c84de8bc9f83b4c93cff8061, regionState=CLOSED 2023-07-11 20:13:58,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:58,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106438200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106438200"}]},"ts":"1689106438200"} 2023-07-11 20:13:58,201 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5b825432e4cdff2abec2bbda6e8c4beb, regionState=CLOSED 2023-07-11 20:13:58,201 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106438201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106438201"}]},"ts":"1689106438201"} 2023-07-11 20:13:58,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-11 20:13:58,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 91d0fd34c84de8bc9f83b4c93cff8061, server=jenkins-hbase4.apache.org,41061,1689106361927 in 178 msec 2023-07-11 20:13:58,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-11 20:13:58,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 5b825432e4cdff2abec2bbda6e8c4beb, server=jenkins-hbase4.apache.org,46545,1689106361876 in 178 msec 2023-07-11 20:13:58,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91d0fd34c84de8bc9f83b4c93cff8061, UNASSIGN in 184 msec 2023-07-11 20:13:58,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-11 20:13:58,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b825432e4cdff2abec2bbda6e8c4beb, UNASSIGN in 186 msec 2023-07-11 20:13:58,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106438207"}]},"ts":"1689106438207"} 2023-07-11 20:13:58,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-11 20:13:58,210 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-11 20:13:58,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 201 msec 2023-07-11 20:13:58,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:13:58,317 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-11 20:13:58,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-11 20:13:58,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,322 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-11 20:13:58,322 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,325 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-11 20:13:58,328 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,328 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,328 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,329 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,329 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:58,329 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:58,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:13:58,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:13:58,330 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-11 20:13:58,331 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,331 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:13:58,332 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,332 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/recovered.edits] 2023-07-11 20:13:58,332 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/recovered.edits] 2023-07-11 20:13:58,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 20:13:58,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/cf/0a4127e07ea04cdf9998545f95263cc7 2023-07-11 20:13:58,338 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/cf/e92823fd091d4102a432a7745be99945 2023-07-11 20:13:58,343 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb/recovered.edits/9.seqid 2023-07-11 20:13:58,343 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061/recovered.edits/9.seqid 2023-07-11 20:13:58,343 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/5b825432e4cdff2abec2bbda6e8c4beb 2023-07-11 20:13:58,344 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testConsecutiveExports/91d0fd34c84de8bc9f83b4c93cff8061 2023-07-11 20:13:58,344 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 20:13:58,347 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,350 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-11 20:13:58,352 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-11 20:13:58,353 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,354 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-11 20:13:58,354 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106438354"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:58,354 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106438354"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:58,356 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:13:58,356 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 91d0fd34c84de8bc9f83b4c93cff8061, NAME => 'testtb-testConsecutiveExports,,1689106405731.91d0fd34c84de8bc9f83b4c93cff8061.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5b825432e4cdff2abec2bbda6e8c4beb, NAME => 'testtb-testConsecutiveExports,1,1689106405731.5b825432e4cdff2abec2bbda6e8c4beb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:13:58,356 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-11 20:13:58,356 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106438356"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:58,358 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-11 20:13:58,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:58,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-07-11 20:13:58,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 20:13:58,434 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-11 20:13:58,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-11 20:13:58,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:58,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-11 20:13:58,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-11 20:13:58,474 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 768), OpenFileDescriptor=905 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 479), ProcessCount=180 (was 180), AvailableMemoryMB=2303 (was 1648) - AvailableMemoryMB LEAK? - 2023-07-11 20:13:58,474 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-11 20:13:58,495 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=180, AvailableMemoryMB=2303 2023-07-11 20:13:58,495 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-11 20:13:58,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:13:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:58,500 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:13:58,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-11 20:13:58,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:13:58,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:13:58,504 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,504 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,504 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a empty. 2023-07-11 20:13:58,504 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c empty. 2023-07-11 20:13:58,505 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,505 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,505 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 20:13:58,515 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-11 20:13:58,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e733e2b6ff221c5986295f8f072601a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:58,516 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61da7f265a387f5a69c6dc06b304966c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:13:58,525 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:58,525 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 61da7f265a387f5a69c6dc06b304966c, disabling compactions & flushes 2023-07-11 20:13:58,525 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. after waiting 0 ms 2023-07-11 20:13:58,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 61da7f265a387f5a69c6dc06b304966c: 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 5e733e2b6ff221c5986295f8f072601a, disabling compactions & flushes 2023-07-11 20:13:58,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. after waiting 0 ms 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 5e733e2b6ff221c5986295f8f072601a: 2023-07-11 20:13:58,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:13:58,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106438530"}]},"ts":"1689106438530"} 2023-07-11 20:13:58,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106438530"}]},"ts":"1689106438530"} 2023-07-11 20:13:58,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:13:58,537 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:13:58,537 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106438537"}]},"ts":"1689106438537"} 2023-07-11 20:13:58,539 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-11 20:13:58,543 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:13:58,544 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:13:58,544 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:13:58,544 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:13:58,544 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:13:58,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, ASSIGN}] 2023-07-11 20:13:58,546 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, ASSIGN 2023-07-11 20:13:58,547 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, ASSIGN 2023-07-11 20:13:58,547 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35437,1689106361799; forceNewPlan=false, retain=false 2023-07-11 20:13:58,547 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:13:58,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:13:58,697 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:13:58,700 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=61da7f265a387f5a69c6dc06b304966c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:58,700 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5e733e2b6ff221c5986295f8f072601a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:58,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106438700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106438700"}]},"ts":"1689106438700"} 2023-07-11 20:13:58,701 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106438700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106438700"}]},"ts":"1689106438700"} 2023-07-11 20:13:58,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 5e733e2b6ff221c5986295f8f072601a, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:13:58,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 61da7f265a387f5a69c6dc06b304966c, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:13:58,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:13:58,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e733e2b6ff221c5986295f8f072601a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:13:58,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61da7f265a387f5a69c6dc06b304966c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. service=AccessControlService 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. service=AccessControlService 2023-07-11 20:13:58,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:58,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,867 INFO [StoreOpener-5e733e2b6ff221c5986295f8f072601a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,867 INFO [StoreOpener-61da7f265a387f5a69c6dc06b304966c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,869 DEBUG [StoreOpener-5e733e2b6ff221c5986295f8f072601a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf 2023-07-11 20:13:58,869 DEBUG [StoreOpener-61da7f265a387f5a69c6dc06b304966c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf 2023-07-11 20:13:58,869 DEBUG [StoreOpener-5e733e2b6ff221c5986295f8f072601a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf 2023-07-11 20:13:58,869 DEBUG [StoreOpener-61da7f265a387f5a69c6dc06b304966c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf 2023-07-11 20:13:58,870 INFO [StoreOpener-5e733e2b6ff221c5986295f8f072601a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e733e2b6ff221c5986295f8f072601a columnFamilyName cf 2023-07-11 20:13:58,870 INFO [StoreOpener-61da7f265a387f5a69c6dc06b304966c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61da7f265a387f5a69c6dc06b304966c columnFamilyName cf 2023-07-11 20:13:58,871 INFO [StoreOpener-61da7f265a387f5a69c6dc06b304966c-1] regionserver.HStore(310): Store=61da7f265a387f5a69c6dc06b304966c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:58,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,874 INFO [StoreOpener-5e733e2b6ff221c5986295f8f072601a-1] regionserver.HStore(310): Store=5e733e2b6ff221c5986295f8f072601a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:58,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:13:58,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:58,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61da7f265a387f5a69c6dc06b304966c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63656006, jitterRate=-0.05145159363746643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:58,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61da7f265a387f5a69c6dc06b304966c: 2023-07-11 20:13:58,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:13:58,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c., pid=61, masterSystemTime=1689106438855 2023-07-11 20:13:58,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:58,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e733e2b6ff221c5986295f8f072601a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70633005, jitterRate=0.05251379311084747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:58,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e733e2b6ff221c5986295f8f072601a: 2023-07-11 20:13:58,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:58,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a., pid=60, masterSystemTime=1689106438854 2023-07-11 20:13:58,883 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=61da7f265a387f5a69c6dc06b304966c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:58,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106438883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106438883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106438883"}]},"ts":"1689106438883"} 2023-07-11 20:13:58,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:58,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5e733e2b6ff221c5986295f8f072601a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:58,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106438885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106438885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106438885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106438885"}]},"ts":"1689106438885"} 2023-07-11 20:13:58,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-11 20:13:58,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 61da7f265a387f5a69c6dc06b304966c, server=jenkins-hbase4.apache.org,46545,1689106361876 in 182 msec 2023-07-11 20:13:58,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, ASSIGN in 343 msec 2023-07-11 20:13:58,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-11 20:13:58,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 5e733e2b6ff221c5986295f8f072601a, server=jenkins-hbase4.apache.org,35437,1689106361799 in 185 msec 2023-07-11 20:13:58,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-11 20:13:58,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, ASSIGN in 345 msec 2023-07-11 20:13:58,891 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:13:58,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106438891"}]},"ts":"1689106438891"} 2023-07-11 20:13:58,893 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-11 20:13:58,895 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:13:58,895 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-11 20:13:58,897 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:13:58,899 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,899 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,899 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,899 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:58,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:58,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:58,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:58,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:58,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-07-11 20:13:59,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:13:59,105 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-11 20:13:59,105 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-11 20:13:59,105 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:59,109 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-11 20:13:59,109 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:59,109 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-11 20:13:59,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106439112 (current time:1689106439112). 2023-07-11 20:13:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x0345cf00 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:59,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5221884d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:59,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,123 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0345cf00 to 127.0.0.1:50019 2023-07-11 20:13:59,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:59,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x5ae3a09c to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f3590f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:59,131 DEBUG [hconnection-0x294ed45c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,132 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,139 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ae3a09c to 127.0.0.1:50019 2023-07-11 20:13:59,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:59,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:13:59,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:59,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,145 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,145 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689107039145 2023-07-11 20:13:59,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,147 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:59,147 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:59,148 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:13:59,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-11 20:13:59,150 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:13:59,151 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689107039151 2023-07-11 20:13:59,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,162 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:13:59,163 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,164 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 20:13:59,164 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 20:13:59,164 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,165 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,166 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,166 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,166 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,166 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,167 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,167 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,167 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,167 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,168 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,172 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,172 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,172 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,174 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,174 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,175 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a75a08f[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:13:59,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a75a08f[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:59,179 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 20:13:59,179 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:13:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:59,181 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,181 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:59,182 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:59,182 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. started... 2023-07-11 20:13:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:59,182 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:59,183 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e733e2b6ff221c5986295f8f072601a: 2023-07-11 20:13:59,182 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,184 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:59,183 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. started... 2023-07-11 20:13:59,184 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,184 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:59,184 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:59,185 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61da7f265a387f5a69c6dc06b304966c: 2023-07-11 20:13:59,185 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,185 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:59,185 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:59,190 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:13:59,190 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,190 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:13:59,196 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. completed. 2023-07-11 20:13:59,196 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:13:59,196 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. completed. 2023-07-11 20:13:59,196 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:13:59,196 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:59,198 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,198 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:13:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,198 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,198 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:13:59,200 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,200 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:13:59,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,200 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,200 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:13:59,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:59,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 20:13:59,210 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 20:13:59,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:59,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:59,210 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,211 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,214 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,213 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,214 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,215 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,217 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,218 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,218 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,222 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,224 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:59,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,222 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,225 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:59,247 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:13:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:59,249 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:59,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 20:13:59,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,297 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689106439146Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106439224 (+78 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106439224Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106439235 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106439259 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689106439297 (+38 ms) 2023-07-11 20:13:59,301 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:13:59,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 155 msec 2023-07-11 20:13:59,449 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:59,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:13:59,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:59,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:59,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:59,481 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,481 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:59,483 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:59,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106439497 (current time:1689106439497). 2023-07-11 20:13:59,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:59,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x3654d083 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:59,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788d6920, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:59,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,509 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3654d083 to 127.0.0.1:50019 2023-07-11 20:13:59,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:59,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x25d3a1ca to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:59,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3593ad3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:59,520 DEBUG [hconnection-0x26c406c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,524 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:59,532 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:59,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25d3a1ca to 127.0.0.1:50019 2023-07-11 20:13:59,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:59,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:13:59,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:59,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,539 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,539 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689107039539 2023-07-11 20:13:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:13:59,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:59,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:13:59,542 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:13:59,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-11 20:13:59,545 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:13:59,545 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689107039545 2023-07-11 20:13:59,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,554 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:13:59,554 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,556 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 20:13:59,556 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 20:13:59,556 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,556 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,558 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,558 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,558 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,558 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,558 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,559 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:13:59,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:13:59,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,563 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,563 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,570 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,577 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:13:59,577 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:13:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,578 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,577 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:13:59,579 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:13:59,580 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,581 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,581 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,581 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,582 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a921680[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:13:59,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a921680[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:59,587 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 20:13:59,587 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,592 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,592 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:59,593 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:59,593 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:59,594 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. started... 2023-07-11 20:13:59,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,594 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,594 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:13:59,594 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61da7f265a387f5a69c6dc06b304966c 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-11 20:13:59,594 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:59,594 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:59,594 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:13:59,594 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. started... 2023-07-11 20:13:59,595 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5e733e2b6ff221c5986295f8f072601a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-11 20:13:59,595 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:13:59,595 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,595 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:13:59,595 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,597 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:59,635 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/.tmp/cf/b34f446d31fd48828f82c3c7dbcb384e 2023-07-11 20:13:59,642 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:59,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:13:59,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:59,645 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/.tmp/cf/52f90459664443c8aee52cc9d4640333 2023-07-11 20:13:59,645 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:59,645 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/.tmp/cf/b34f446d31fd48828f82c3c7dbcb384e as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e 2023-07-11 20:13:59,655 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/.tmp/cf/52f90459664443c8aee52cc9d4640333 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333 2023-07-11 20:13:59,655 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e, entries=5, sequenceid=6, filesize=5.2 K 2023-07-11 20:13:59,657 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5e733e2b6ff221c5986295f8f072601a in 62ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:59,657 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:13:59,658 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e733e2b6ff221c5986295f8f072601a: 2023-07-11 20:13:59,658 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,658 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:59,658 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e] hfiles 2023-07-11 20:13:59,658 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,661 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333, entries=45, sequenceid=6, filesize=7.9 K 2023-07-11 20:13:59,664 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 61da7f265a387f5a69c6dc06b304966c in 70ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:59,666 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61da7f265a387f5a69c6dc06b304966c: 2023-07-11 20:13:59,667 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,667 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:59,667 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333] hfiles 2023-07-11 20:13:59,667 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,682 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. completed. 2023-07-11 20:13:59,683 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:13:59,683 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:59,683 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:59,683 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,683 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:13:59,683 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:13:59,685 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:13:59,685 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:59,685 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,685 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:13:59,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:59,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:59,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:59,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:59,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:13:59,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:59,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:13:59,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:13:59,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:13:59,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:13:59,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 20:13:59,845 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:59,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:13:59,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:59,847 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:00,072 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. completed. 2023-07-11 20:14:00,072 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:14:00,072 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:00,072 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:00,072 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:00,073 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:00,076 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:00,076 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:00,076 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:00,078 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:00,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:14:00,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 20:14:00,087 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 20:14:00,087 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:00,087 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:00,087 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,087 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:00,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:00,095 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,096 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:00,096 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:00,098 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,098 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,099 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:00,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,102 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:00,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:00,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:00,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:00,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:00,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:00,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,105 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,106 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:00,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:00,147 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:00,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:00,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:00,150 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:14:00,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 20:14:00,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,643 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689106439540Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689106440104 (+564 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689106440104Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689106440114 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689106440147 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689106440643 (+496 ms) 2023-07-11 20:14:00,647 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:00,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.1060 sec 2023-07-11 20:14:00,650 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:00,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:00,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:00,690 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:00,695 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:00,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35437] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:00,698 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:00,710 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:00,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41061] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:00,712 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:00,723 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:00,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:00,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:14:00,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:00,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:00,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-11 20:14:00,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:00,738 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:00,745 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:00,747 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:00,755 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e empty. 2023-07-11 20:14:00,756 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:00,756 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b empty. 2023-07-11 20:14:00,766 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:00,766 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 20:14:00,783 WARN [DataStreamer for file /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tmp/.tableinfo.0000000001] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-11 20:14:00,785 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:00,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 55707009ae544eb8536aa2d4e8dda49e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:00,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4a3aae551bbdd69dc1173c6c6f5fb00b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:00,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 55707009ae544eb8536aa2d4e8dda49e, disabling compactions & flushes 2023-07-11 20:14:00,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:00,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:00,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. after waiting 0 ms 2023-07-11 20:14:00,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:00,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:00,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 55707009ae544eb8536aa2d4e8dda49e: 2023-07-11 20:14:00,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4a3aae551bbdd69dc1173c6c6f5fb00b, disabling compactions & flushes 2023-07-11 20:14:00,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:00,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:00,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. after waiting 0 ms 2023-07-11 20:14:00,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:00,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:00,819 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4a3aae551bbdd69dc1173c6c6f5fb00b: 2023-07-11 20:14:00,822 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:00,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106440823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106440823"}]},"ts":"1689106440823"} 2023-07-11 20:14:00,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106440823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106440823"}]},"ts":"1689106440823"} 2023-07-11 20:14:00,834 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:00,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:00,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106440837"}]},"ts":"1689106440837"} 2023-07-11 20:14:00,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:00,839 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-11 20:14:00,845 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:00,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:00,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:00,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:00,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:00,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, ASSIGN}] 2023-07-11 20:14:00,852 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, ASSIGN 2023-07-11 20:14:00,853 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, ASSIGN 2023-07-11 20:14:00,855 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:14:00,856 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:14:01,006 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:01,010 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4a3aae551bbdd69dc1173c6c6f5fb00b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:01,010 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106441010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106441010"}]},"ts":"1689106441010"} 2023-07-11 20:14:01,010 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=55707009ae544eb8536aa2d4e8dda49e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:01,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106441010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106441010"}]},"ts":"1689106441010"} 2023-07-11 20:14:01,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 4a3aae551bbdd69dc1173c6c6f5fb00b, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:01,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 55707009ae544eb8536aa2d4e8dda49e, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:01,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:01,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 55707009ae544eb8536aa2d4e8dda49e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.', STARTKEY => '', ENDKEY => '2'} 2023-07-11 20:14:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. service=AccessControlService 2023-07-11 20:14:01,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:01,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:01,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a3aae551bbdd69dc1173c6c6f5fb00b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 20:14:01,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. service=AccessControlService 2023-07-11 20:14:01,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,195 INFO [StoreOpener-4a3aae551bbdd69dc1173c6c6f5fb00b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,197 INFO [StoreOpener-55707009ae544eb8536aa2d4e8dda49e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,197 DEBUG [StoreOpener-4a3aae551bbdd69dc1173c6c6f5fb00b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf 2023-07-11 20:14:01,197 DEBUG [StoreOpener-4a3aae551bbdd69dc1173c6c6f5fb00b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf 2023-07-11 20:14:01,198 INFO [StoreOpener-4a3aae551bbdd69dc1173c6c6f5fb00b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a3aae551bbdd69dc1173c6c6f5fb00b columnFamilyName cf 2023-07-11 20:14:01,199 DEBUG [StoreOpener-55707009ae544eb8536aa2d4e8dda49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf 2023-07-11 20:14:01,199 DEBUG [StoreOpener-55707009ae544eb8536aa2d4e8dda49e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf 2023-07-11 20:14:01,199 INFO [StoreOpener-4a3aae551bbdd69dc1173c6c6f5fb00b-1] regionserver.HStore(310): Store=4a3aae551bbdd69dc1173c6c6f5fb00b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:01,199 INFO [StoreOpener-55707009ae544eb8536aa2d4e8dda49e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55707009ae544eb8536aa2d4e8dda49e columnFamilyName cf 2023-07-11 20:14:01,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,200 INFO [StoreOpener-55707009ae544eb8536aa2d4e8dda49e-1] regionserver.HStore(310): Store=55707009ae544eb8536aa2d4e8dda49e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:01,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:01,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:01,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a3aae551bbdd69dc1173c6c6f5fb00b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64226351, jitterRate=-0.04295279085636139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a3aae551bbdd69dc1173c6c6f5fb00b: 2023-07-11 20:14:01,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 55707009ae544eb8536aa2d4e8dda49e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68308751, jitterRate=0.017879709601402283}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:01,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 55707009ae544eb8536aa2d4e8dda49e: 2023-07-11 20:14:01,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e., pid=70, masterSystemTime=1689106441176 2023-07-11 20:14:01,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b., pid=69, masterSystemTime=1689106441176 2023-07-11 20:14:01,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,226 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=55707009ae544eb8536aa2d4e8dda49e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:01,226 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106441226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106441226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106441226"}]},"ts":"1689106441226"} 2023-07-11 20:14:01,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,231 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4a3aae551bbdd69dc1173c6c6f5fb00b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:01,231 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441230"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106441230"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106441230"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106441230"}]},"ts":"1689106441230"} 2023-07-11 20:14:01,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-11 20:14:01,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 55707009ae544eb8536aa2d4e8dda49e, server=jenkins-hbase4.apache.org,41061,1689106361927 in 208 msec 2023-07-11 20:14:01,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-11 20:14:01,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 4a3aae551bbdd69dc1173c6c6f5fb00b, server=jenkins-hbase4.apache.org,46545,1689106361876 in 216 msec 2023-07-11 20:14:01,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, ASSIGN in 390 msec 2023-07-11 20:14:01,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-11 20:14:01,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, ASSIGN in 392 msec 2023-07-11 20:14:01,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:01,245 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106441244"}]},"ts":"1689106441244"} 2023-07-11 20:14:01,247 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-11 20:14:01,250 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:01,250 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-11 20:14:01,253 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 20:14:01,255 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:01,255 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:01,255 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:01,255 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:01,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:01,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 532 msec 2023-07-11 20:14:01,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:01,346 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-11 20:14:01,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b], force=true 2023-07-11 20:14:01,401 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b], force=true 2023-07-11 20:14:01,402 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b], force=true 2023-07-11 20:14:01,402 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b], force=true 2023-07-11 20:14:01,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:01,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, UNASSIGN}] 2023-07-11 20:14:01,437 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, UNASSIGN 2023-07-11 20:14:01,438 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, UNASSIGN 2023-07-11 20:14:01,438 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=55707009ae544eb8536aa2d4e8dda49e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:01,439 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106441438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106441438"}]},"ts":"1689106441438"} 2023-07-11 20:14:01,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4a3aae551bbdd69dc1173c6c6f5fb00b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:01,440 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106441439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106441439"}]},"ts":"1689106441439"} 2023-07-11 20:14:01,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 55707009ae544eb8536aa2d4e8dda49e, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:01,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4a3aae551bbdd69dc1173c6c6f5fb00b, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:01,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:01,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 55707009ae544eb8536aa2d4e8dda49e, disabling compactions & flushes 2023-07-11 20:14:01,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. after waiting 0 ms 2023-07-11 20:14:01,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 55707009ae544eb8536aa2d4e8dda49e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 20:14:01,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a3aae551bbdd69dc1173c6c6f5fb00b, disabling compactions & flushes 2023-07-11 20:14:01,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. after waiting 0 ms 2023-07-11 20:14:01,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4a3aae551bbdd69dc1173c6c6f5fb00b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 20:14:01,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/.tmp/cf/4582c0a11d1d44a3917cd48891cb72d9 2023-07-11 20:14:01,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/.tmp/cf/19da031518504e61931dea286a51a918 2023-07-11 20:14:01,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/.tmp/cf/4582c0a11d1d44a3917cd48891cb72d9 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9 2023-07-11 20:14:01,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/.tmp/cf/19da031518504e61931dea286a51a918 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918 2023-07-11 20:14:01,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 20:14:01,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4a3aae551bbdd69dc1173c6c6f5fb00b in 59ms, sequenceid=5, compaction requested=false 2023-07-11 20:14:01,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 20:14:01,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 20:14:01,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 55707009ae544eb8536aa2d4e8dda49e in 79ms, sequenceid=5, compaction requested=false 2023-07-11 20:14:01,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:14:01,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:01,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b. 2023-07-11 20:14:01,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a3aae551bbdd69dc1173c6c6f5fb00b: 2023-07-11 20:14:01,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:01,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4a3aae551bbdd69dc1173c6c6f5fb00b, regionState=CLOSED 2023-07-11 20:14:01,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106441688"}]},"ts":"1689106441688"} 2023-07-11 20:14:01,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:14:01,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:01,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-11 20:14:01,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e. 2023-07-11 20:14:01,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 55707009ae544eb8536aa2d4e8dda49e: 2023-07-11 20:14:01,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4a3aae551bbdd69dc1173c6c6f5fb00b, server=jenkins-hbase4.apache.org,46545,1689106361876 in 247 msec 2023-07-11 20:14:01,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:01,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a3aae551bbdd69dc1173c6c6f5fb00b, UNASSIGN in 259 msec 2023-07-11 20:14:01,696 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=55707009ae544eb8536aa2d4e8dda49e, regionState=CLOSED 2023-07-11 20:14:01,697 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106441696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106441696"}]},"ts":"1689106441696"} 2023-07-11 20:14:01,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-11 20:14:01,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 55707009ae544eb8536aa2d4e8dda49e, server=jenkins-hbase4.apache.org,41061,1689106361927 in 256 msec 2023-07-11 20:14:01,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 20:14:01,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=55707009ae544eb8536aa2d4e8dda49e, UNASSIGN in 271 msec 2023-07-11 20:14:01,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:01,848 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 20:14:01,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440725.55707009ae544eb8536aa2d4e8dda49e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:01,851 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106440725.4a3aae551bbdd69dc1173c6c6f5fb00b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:01,852 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:01,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, ASSIGN}] 2023-07-11 20:14:01,927 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, ASSIGN 2023-07-11 20:14:01,928 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:14:02,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:02,078 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:14:02,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=78b6819b40f48cb77bc692b580c9c20d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,081 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106442081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106442081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106442081"}]},"ts":"1689106442081"} 2023-07-11 20:14:02,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 78b6819b40f48cb77bc692b580c9c20d, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:02,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:02,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78b6819b40f48cb77bc692b580c9c20d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:14:02,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. service=AccessControlService 2023-07-11 20:14:02,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:02,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:02,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/.regioninfo 2023-07-11 20:14:02,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0004_000001 (auth:SIMPLE) 2023-07-11 20:14:02,334 INFO [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,335 DEBUG [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf 2023-07-11 20:14:02,335 DEBUG [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf 2023-07-11 20:14:02,336 INFO [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78b6819b40f48cb77bc692b580c9c20d columnFamilyName cf 2023-07-11 20:14:02,372 DEBUG [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] regionserver.HStore(539): loaded hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/19da031518504e61931dea286a51a918.55707009ae544eb8536aa2d4e8dda49e->hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918-top 2023-07-11 20:14:02,380 DEBUG [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] regionserver.HStore(539): loaded hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/4582c0a11d1d44a3917cd48891cb72d9.4a3aae551bbdd69dc1173c6c6f5fb00b->hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9-top 2023-07-11 20:14:02,381 INFO [StoreOpener-78b6819b40f48cb77bc692b580c9c20d-1] regionserver.HStore(310): Store=78b6819b40f48cb77bc692b580c9c20d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:02,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:02,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78b6819b40f48cb77bc692b580c9c20d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60119423, jitterRate=-0.10415078699588776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:02,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78b6819b40f48cb77bc692b580c9c20d: 2023-07-11 20:14:02,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d., pid=77, masterSystemTime=1689106442241 2023-07-11 20:14:02,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.,because compaction is disabled. 2023-07-11 20:14:02,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:02,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:02,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=78b6819b40f48cb77bc692b580c9c20d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106442410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106442410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106442410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106442410"}]},"ts":"1689106442410"} 2023-07-11 20:14:02,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 20:14:02,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 78b6819b40f48cb77bc692b580c9c20d, server=jenkins-hbase4.apache.org,41061,1689106361927 in 327 msec 2023-07-11 20:14:02,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-11 20:14:02,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, ASSIGN in 488 msec 2023-07-11 20:14:02,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[55707009ae544eb8536aa2d4e8dda49e, 4a3aae551bbdd69dc1173c6c6f5fb00b], force=true in 1.0260 sec 2023-07-11 20:14:02,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:02,513 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-11 20:14:02,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:02,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106442516 (current time:1689106442516). 2023-07-11 20:14:02,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:02,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x7521331e to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:02,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ab82ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:02,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:02,572 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7521331e to 127.0.0.1:50019 2023-07-11 20:14:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:02,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x06e8e743 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:02,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aad8d43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:02,632 DEBUG [hconnection-0x648fcc0a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:02,636 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:02,643 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:02,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06e8e743 to 127.0.0.1:50019 2023-07-11 20:14:02,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:02,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 20:14:02,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:02,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:02,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:02,648 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:02,649 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689107042649 2023-07-11 20:14:02,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:02,652 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:02,653 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:02,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:02,654 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:02,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-11 20:14:02,655 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:02,656 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689107042656 2023-07-11 20:14:02,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,706 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 20:14:02,706 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:02,708 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-11 20:14:02,708 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-11 20:14:02,708 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,708 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,753 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:02,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:02,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:02,754 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:02,760 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,760 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,760 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,760 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:02,761 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:02,762 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:02,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:02,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:02,764 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:02,765 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:02,765 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:02,765 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:02,766 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,913 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,913 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:02,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-11 20:14:02,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c61300c[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:02,917 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-11 20:14:02,917 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,922 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:02,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,923 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:02,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:02,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,923 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:02,923 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. started... 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:14:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:02,925 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78b6819b40f48cb77bc692b580c9c20d: 2023-07-11 20:14:02,925 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,925 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:02,925 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/19da031518504e61931dea286a51a918.55707009ae544eb8536aa2d4e8dda49e->hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918-top, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/4582c0a11d1d44a3917cd48891cb72d9.4a3aae551bbdd69dc1173c6c6f5fb00b->hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9-top] hfiles 2023-07-11 20:14:02,925 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/19da031518504e61931dea286a51a918.55707009ae544eb8536aa2d4e8dda49e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,926 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/4582c0a11d1d44a3917cd48891cb72d9.4a3aae551bbdd69dc1173c6c6f5fb00b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:02,937 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:02,937 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,937 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,937 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:02,937 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:02,945 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. completed. 2023-07-11 20:14:02,945 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:02,946 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:14:02,954 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:02,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:02,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:02,955 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:02,956 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:02,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:02,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:02,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:14:02,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-11 20:14:02,960 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-11 20:14:02,960 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:02,960 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:02,960 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,960 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,963 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:02,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,962 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,963 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:02,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,964 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,966 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,966 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:02,967 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,971 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:02,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-11 20:14:02,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,972 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:02,973 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:02,973 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,973 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:03,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:03,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-11 20:14:03,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:03,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:03,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689106442649Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106442971 (+322 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106442971Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106442977 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106443011 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689106443109 (+98 ms) 2023-07-11 20:14:03,113 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:03,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 461 msec 2023-07-11 20:14:03,256 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:03,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:03,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:03,257 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257 2023-07-11 20:14:03,257 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36637, tgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257, rawTgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:03,295 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:03,295 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_357797435_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:03,295 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-11 20:14:03,320 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:03,411 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,412 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,413 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,413 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,414 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,414 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,414 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,510 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-4427929116498691787.jar 2023-07-11 20:14:03,510 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,511 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,511 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,512 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,512 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,513 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:03,514 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:03,514 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:03,515 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:03,516 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:03,516 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:03,517 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:03,517 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:03,518 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:03,518 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:03,519 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:03,520 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:03,520 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:03,521 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:03,521 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:03,521 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:03,522 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:03,523 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:03,827 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:04,809 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:04,812 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-11 20:14:04,814 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-11 20:14:05,009 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:05,010 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:05,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:10,359 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:12,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:18,174 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:18,175 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:18,184 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,184 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:18,185 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:18,185 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,186 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 20:14:18,186 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 20:14:18,186 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,187 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 20:14:18,187 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106443257/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 20:14:18,197 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,205 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106458204"}]},"ts":"1689106458204"} 2023-07-11 20:14:18,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:18,211 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-11 20:14:18,213 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-11 20:14:18,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, UNASSIGN}] 2023-07-11 20:14:18,217 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, UNASSIGN 2023-07-11 20:14:18,218 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=78b6819b40f48cb77bc692b580c9c20d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:18,218 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106458218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106458218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106458218"}]},"ts":"1689106458218"} 2023-07-11 20:14:18,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 78b6819b40f48cb77bc692b580c9c20d, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:18,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:18,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:18,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78b6819b40f48cb77bc692b580c9c20d, disabling compactions & flushes 2023-07-11 20:14:18,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:18,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:18,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. after waiting 0 ms 2023-07-11 20:14:18,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:18,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-11 20:14:18,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:18,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d. 2023-07-11 20:14:18,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78b6819b40f48cb77bc692b580c9c20d: 2023-07-11 20:14:18,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:18,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=78b6819b40f48cb77bc692b580c9c20d, regionState=CLOSED 2023-07-11 20:14:18,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106458416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106458416"}]},"ts":"1689106458416"} 2023-07-11 20:14:18,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-11 20:14:18,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 78b6819b40f48cb77bc692b580c9c20d, server=jenkins-hbase4.apache.org,41061,1689106361927 in 197 msec 2023-07-11 20:14:18,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 20:14:18,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=78b6819b40f48cb77bc692b580c9c20d, UNASSIGN in 206 msec 2023-07-11 20:14:18,430 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106458430"}]},"ts":"1689106458430"} 2023-07-11 20:14:18,432 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-11 20:14:18,433 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-11 20:14:18,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 236 msec 2023-07-11 20:14:18,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:18,508 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-11 20:14:18,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,517 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,519 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,522 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,522 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,522 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,522 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:18,522 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:18,522 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,523 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:18,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:18,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:18,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:18,524 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/recovered.edits] 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,525 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/recovered.edits] 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,525 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-11 20:14:18,525 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:14:18,525 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/recovered.edits] 2023-07-11 20:14:18,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 20:14:18,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:18,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:18,532 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/19da031518504e61931dea286a51a918.55707009ae544eb8536aa2d4e8dda49e to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/19da031518504e61931dea286a51a918.55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:18,532 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/cf/19da031518504e61931dea286a51a918 2023-07-11 20:14:18,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:18,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:18,536 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/cf/4582c0a11d1d44a3917cd48891cb72d9 2023-07-11 20:14:18,536 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/4582c0a11d1d44a3917cd48891cb72d9.4a3aae551bbdd69dc1173c6c6f5fb00b to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/cf/4582c0a11d1d44a3917cd48891cb72d9.4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:18,541 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/recovered.edits/8.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e/recovered.edits/8.seqid 2023-07-11 20:14:18,543 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/recovered.edits/8.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b/recovered.edits/8.seqid 2023-07-11 20:14:18,543 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/55707009ae544eb8536aa2d4e8dda49e 2023-07-11 20:14:18,547 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a3aae551bbdd69dc1173c6c6f5fb00b 2023-07-11 20:14:18,548 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/recovered.edits/12.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d/recovered.edits/12.seqid 2023-07-11 20:14:18,548 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/78b6819b40f48cb77bc692b580c9c20d 2023-07-11 20:14:18,548 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 20:14:18,551 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,553 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-11 20:14:18,555 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-11 20:14:18,557 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,557 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-11 20:14:18,557 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106458557"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:18,564 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 20:14:18,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 78b6819b40f48cb77bc692b580c9c20d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106440726.78b6819b40f48cb77bc692b580c9c20d.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 20:14:18,564 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-11 20:14:18,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106458564"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:18,571 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-11 20:14:18,577 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:18,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 67 msec 2023-07-11 20:14:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 20:14:18,634 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-11 20:14:18,635 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:18,644 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106458643"}]},"ts":"1689106458643"} 2023-07-11 20:14:18,645 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-11 20:14:18,647 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-11 20:14:18,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, UNASSIGN}] 2023-07-11 20:14:18,649 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, UNASSIGN 2023-07-11 20:14:18,651 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, UNASSIGN 2023-07-11 20:14:18,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=61da7f265a387f5a69c6dc06b304966c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:18,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106458651"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106458651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106458651"}]},"ts":"1689106458651"} 2023-07-11 20:14:18,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5e733e2b6ff221c5986295f8f072601a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:18,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106458652"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106458652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106458652"}]},"ts":"1689106458652"} 2023-07-11 20:14:18,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 61da7f265a387f5a69c6dc06b304966c, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:18,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 5e733e2b6ff221c5986295f8f072601a, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:14:18,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:18,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:14:18,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:14:18,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61da7f265a387f5a69c6dc06b304966c, disabling compactions & flushes 2023-07-11 20:14:18,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e733e2b6ff221c5986295f8f072601a, disabling compactions & flushes 2023-07-11 20:14:18,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:14:18,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. after waiting 0 ms 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. after waiting 0 ms 2023-07-11 20:14:18,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:14:18,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:18,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:18,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:18,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a. 2023-07-11 20:14:18,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e733e2b6ff221c5986295f8f072601a: 2023-07-11 20:14:18,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:18,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c. 2023-07-11 20:14:18,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61da7f265a387f5a69c6dc06b304966c: 2023-07-11 20:14:18,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:14:18,840 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5e733e2b6ff221c5986295f8f072601a, regionState=CLOSED 2023-07-11 20:14:18,840 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106458839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106458839"}]},"ts":"1689106458839"} 2023-07-11 20:14:18,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:14:18,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=61da7f265a387f5a69c6dc06b304966c, regionState=CLOSED 2023-07-11 20:14:18,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106458840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106458840"}]},"ts":"1689106458840"} 2023-07-11 20:14:18,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-11 20:14:18,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 5e733e2b6ff221c5986295f8f072601a, server=jenkins-hbase4.apache.org,35437,1689106361799 in 186 msec 2023-07-11 20:14:18,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-11 20:14:18,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5e733e2b6ff221c5986295f8f072601a, UNASSIGN in 195 msec 2023-07-11 20:14:18,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 61da7f265a387f5a69c6dc06b304966c, server=jenkins-hbase4.apache.org,46545,1689106361876 in 188 msec 2023-07-11 20:14:18,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-11 20:14:18,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=61da7f265a387f5a69c6dc06b304966c, UNASSIGN in 196 msec 2023-07-11 20:14:18,846 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106458846"}]},"ts":"1689106458846"} 2023-07-11 20:14:18,847 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-11 20:14:18,849 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-11 20:14:18,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 215 msec 2023-07-11 20:14:18,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:18,946 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-11 20:14:18,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,952 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,959 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,961 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,967 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,968 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,968 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,968 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:18,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:18,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:18,969 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:14:18,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:18,969 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:14:18,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,970 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:18,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,971 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:18,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 20:14:18,979 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/recovered.edits] 2023-07-11 20:14:18,986 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/cf/52f90459664443c8aee52cc9d4640333 2023-07-11 20:14:18,986 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/recovered.edits] 2023-07-11 20:14:18,995 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c/recovered.edits/9.seqid 2023-07-11 20:14:18,998 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/61da7f265a387f5a69c6dc06b304966c 2023-07-11 20:14:18,999 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/cf/b34f446d31fd48828f82c3c7dbcb384e 2023-07-11 20:14:19,004 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a/recovered.edits/9.seqid 2023-07-11 20:14:19,004 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5e733e2b6ff221c5986295f8f072601a 2023-07-11 20:14:19,004 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 20:14:19,008 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:19,012 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-11 20:14:19,017 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-11 20:14:19,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:19,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-11 20:14:19,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106459019"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:19,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106459019"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:19,022 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:19,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5e733e2b6ff221c5986295f8f072601a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106438496.5e733e2b6ff221c5986295f8f072601a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 61da7f265a387f5a69c6dc06b304966c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106438496.61da7f265a387f5a69c6dc06b304966c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:19,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-11 20:14:19,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106459023"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:19,024 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-11 20:14:19,027 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:19,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 80 msec 2023-07-11 20:14:19,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 20:14:19,080 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-11 20:14:19,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 20:14:19,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:19,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 20:14:19,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:19,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-11 20:14:19,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:19,148 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:57562 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:33805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:53334 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_834439911_1 at /127.0.0.1:34222 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:34236 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=568 (was 413) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=1266 (was 2303) 2023-07-11 20:14:19,148 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 20:14:19,179 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=568, ProcessCount=187, AvailableMemoryMB=1256 2023-07-11 20:14:19,179 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 20:14:19,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:14:19,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:19,190 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:19,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-11 20:14:19,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:19,195 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,195 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,196 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 empty. 2023-07-11 20:14:19,196 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b empty. 2023-07-11 20:14:19,196 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,196 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,197 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 20:14:19,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:19,226 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:19,227 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => de387c60cc30442ba85deecfb6960c20, NAME => 'testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:19,239 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fce2fbf3b89d24ac86ac084bfb455f3b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:19,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:19,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing de387c60cc30442ba85deecfb6960c20, disabling compactions & flushes 2023-07-11 20:14:19,297 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. after waiting 0 ms 2023-07-11 20:14:19,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,298 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for de387c60cc30442ba85deecfb6960c20: 2023-07-11 20:14:19,300 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:19,300 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fce2fbf3b89d24ac86ac084bfb455f3b, disabling compactions & flushes 2023-07-11 20:14:19,300 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,300 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,300 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. after waiting 0 ms 2023-07-11 20:14:19,300 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,301 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,301 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fce2fbf3b89d24ac86ac084bfb455f3b: 2023-07-11 20:14:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:19,304 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:19,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106459305"}]},"ts":"1689106459305"} 2023-07-11 20:14:19,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106459305"}]},"ts":"1689106459305"} 2023-07-11 20:14:19,308 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:19,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:19,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106459309"}]},"ts":"1689106459309"} 2023-07-11 20:14:19,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 20:14:19,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:19,320 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:19,320 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:19,320 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:19,320 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:19,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, ASSIGN}] 2023-07-11 20:14:19,323 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, ASSIGN 2023-07-11 20:14:19,324 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, ASSIGN 2023-07-11 20:14:19,325 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:14:19,325 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41061,1689106361927; forceNewPlan=false, retain=false 2023-07-11 20:14:19,475 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:19,478 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fce2fbf3b89d24ac86ac084bfb455f3b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=de387c60cc30442ba85deecfb6960c20, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,479 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106459478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106459478"}]},"ts":"1689106459478"} 2023-07-11 20:14:19,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106459478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106459478"}]},"ts":"1689106459478"} 2023-07-11 20:14:19,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fce2fbf3b89d24ac86ac084bfb455f3b, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:19,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure de387c60cc30442ba85deecfb6960c20, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:19,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:19,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fce2fbf3b89d24ac86ac084bfb455f3b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:14:19,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. service=AccessControlService 2023-07-11 20:14:19,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:19,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:19,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de387c60cc30442ba85deecfb6960c20, NAME => 'testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:14:19,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. service=AccessControlService 2023-07-11 20:14:19,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:19,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:19,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,641 INFO [StoreOpener-de387c60cc30442ba85deecfb6960c20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,641 INFO [StoreOpener-fce2fbf3b89d24ac86ac084bfb455f3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,643 DEBUG [StoreOpener-de387c60cc30442ba85deecfb6960c20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf 2023-07-11 20:14:19,643 DEBUG [StoreOpener-de387c60cc30442ba85deecfb6960c20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf 2023-07-11 20:14:19,643 INFO [StoreOpener-de387c60cc30442ba85deecfb6960c20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de387c60cc30442ba85deecfb6960c20 columnFamilyName cf 2023-07-11 20:14:19,644 INFO [StoreOpener-de387c60cc30442ba85deecfb6960c20-1] regionserver.HStore(310): Store=de387c60cc30442ba85deecfb6960c20/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:19,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:19,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:19,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de387c60cc30442ba85deecfb6960c20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68714784, jitterRate=0.023930072784423828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:19,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de387c60cc30442ba85deecfb6960c20: 2023-07-11 20:14:19,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20., pid=94, masterSystemTime=1689106459633 2023-07-11 20:14:19,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:19,659 DEBUG [StoreOpener-fce2fbf3b89d24ac86ac084bfb455f3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf 2023-07-11 20:14:19,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=de387c60cc30442ba85deecfb6960c20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106459659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106459659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106459659"}]},"ts":"1689106459659"} 2023-07-11 20:14:19,659 DEBUG [StoreOpener-fce2fbf3b89d24ac86ac084bfb455f3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf 2023-07-11 20:14:19,661 INFO [StoreOpener-fce2fbf3b89d24ac86ac084bfb455f3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce2fbf3b89d24ac86ac084bfb455f3b columnFamilyName cf 2023-07-11 20:14:19,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-11 20:14:19,663 INFO [StoreOpener-fce2fbf3b89d24ac86ac084bfb455f3b-1] regionserver.HStore(310): Store=fce2fbf3b89d24ac86ac084bfb455f3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:19,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure de387c60cc30442ba85deecfb6960c20, server=jenkins-hbase4.apache.org,41061,1689106361927 in 180 msec 2023-07-11 20:14:19,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, ASSIGN in 343 msec 2023-07-11 20:14:19,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:19,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:19,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fce2fbf3b89d24ac86ac084bfb455f3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65752413, jitterRate=-0.020212695002555847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:19,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fce2fbf3b89d24ac86ac084bfb455f3b: 2023-07-11 20:14:19,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b., pid=93, masterSystemTime=1689106459632 2023-07-11 20:14:19,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:19,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fce2fbf3b89d24ac86ac084bfb455f3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,679 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106459679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106459679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106459679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106459679"}]},"ts":"1689106459679"} 2023-07-11 20:14:19,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-11 20:14:19,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fce2fbf3b89d24ac86ac084bfb455f3b, server=jenkins-hbase4.apache.org,46545,1689106361876 in 201 msec 2023-07-11 20:14:19,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-11 20:14:19,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, ASSIGN in 369 msec 2023-07-11 20:14:19,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:19,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106459694"}]},"ts":"1689106459694"} 2023-07-11 20:14:19,695 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 20:14:19,699 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:19,699 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-11 20:14:19,702 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:19,703 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:19,703 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:19,704 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:19,704 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:19,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:19,714 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:19,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 533 msec 2023-07-11 20:14:19,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:19,719 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:19,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:19,805 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-11 20:14:19,805 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-11 20:14:19,805 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:19,809 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-11 20:14:19,809 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:19,809 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-11 20:14:19,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:19,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106459813 (current time:1689106459813). 2023-07-11 20:14:19,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:19,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x020585b1 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:19,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b5807a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:19,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:19,832 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:19,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x020585b1 to 127.0.0.1:50019 2023-07-11 20:14:19,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:19,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x0c6414b9 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:19,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e22089, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:19,855 DEBUG [hconnection-0x193c4672-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:19,862 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:19,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:19,871 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c6414b9 to 127.0.0.1:50019 2023-07-11 20:14:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:19,884 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:19,885 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689107059885 2023-07-11 20:14:19,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:19,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:19,886 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:19,886 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:19,891 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:19,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:19,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-11 20:14:19,900 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:19,902 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689107059902 2023-07-11 20:14:19,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,953 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-11 20:14:19,953 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:19,955 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 20:14:19,955 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:14:19,956 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,956 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,961 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:19,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:19,961 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:19,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:19,962 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,962 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,962 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,963 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,963 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:19,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:19,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:19,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,967 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:19,968 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:19,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,971 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:19,971 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,977 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:19,977 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,979 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:19,979 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:19,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,981 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:19,981 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:19,981 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:19,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:19,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:19,983 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,983 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,986 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:19,988 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:19,989 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:19,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a772[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:19,989 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:19,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:19,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a772[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:19,993 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:14:19,993 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,994 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,994 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,995 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:19,995 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:19,995 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:19,996 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:19,996 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:20,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:20,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:20,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,003 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:20,005 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:20,005 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. started... 2023-07-11 20:14:20,005 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,005 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,005 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,007 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:20,007 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:20,007 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:20,007 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. started... 2023-07-11 20:14:20,018 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de387c60cc30442ba85deecfb6960c20: 2023-07-11 20:14:20,018 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,018 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:20,018 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:20,018 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fce2fbf3b89d24ac86ac084bfb455f3b: 2023-07-11 20:14:20,019 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,019 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:20,019 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:20,075 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. completed. 2023-07-11 20:14:20,075 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:14:20,077 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,078 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,078 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,078 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:14:20,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:14:20,098 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. completed. 2023-07-11 20:14:20,098 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:20,098 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:20,098 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:20,098 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,098 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,098 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:14:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,102 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:14:20,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:14:20,108 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 20:14:20,108 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:20,108 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:20,108 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,108 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:20,111 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,111 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,111 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,111 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,113 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,113 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,113 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,121 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,121 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,122 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,124 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,124 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,125 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,129 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,129 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,129 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,129 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,130 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,130 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,132 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,132 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,135 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,135 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,135 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-11 20:14:20,188 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:20,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:20,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:20,189 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:20,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 20:14:20,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,241 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689106459886Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689106460134 (+248 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689106460134Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689106460147 (+13 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689106460199 (+52 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689106460240 (+41 ms) 2023-07-11 20:14:20,244 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:20,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 356 msec 2023-07-11 20:14:20,490 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:20,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:20,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:20,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41061] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:20,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:20,503 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:20,504 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:20,504 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:20,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:20,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106460532 (current time:1689106460532). 2023-07-11 20:14:20,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:20,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x1d116cd9 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:20,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6665b6df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:20,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:20,570 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:20,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d116cd9 to 127.0.0.1:50019 2023-07-11 20:14:20,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:20,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x22a526c4 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:20,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3444e1ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:20,605 DEBUG [hconnection-0x7fdc7af4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:20,606 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:20,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:20,611 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:20,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22a526c4 to 127.0.0.1:50019 2023-07-11 20:14:20,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:20,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:20,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:20,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:20,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:20,617 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:20,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:20,617 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689107060617 2023-07-11 20:14:20,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:20,619 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:20,619 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:20,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:20,620 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:20,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-11 20:14:20,622 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:20,623 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689107060623 2023-07-11 20:14:20,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,649 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-11 20:14:20,649 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:20,651 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 20:14:20,651 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:14:20,651 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,651 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,653 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,653 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,653 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,653 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,654 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:20,654 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:20,654 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:20,654 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:20,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,656 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:20,656 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:20,656 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:20,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,656 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:20,657 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:20,657 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:20,657 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:20,657 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:20,658 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:20,657 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:20,661 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:20,662 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,662 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,663 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,663 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,663 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,664 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47640e2f[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:20,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47640e2f[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:20,668 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:14:20,668 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:20,671 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:20,671 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:20,672 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:20,672 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:20,672 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:20,672 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. started... 2023-07-11 20:14:20,673 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. started... 2023-07-11 20:14:20,673 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2745): Flushing de387c60cc30442ba85deecfb6960c20 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 20:14:20,673 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fce2fbf3b89d24ac86ac084bfb455f3b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 20:14:20,674 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,674 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,674 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:20,676 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,676 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,676 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,695 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/.tmp/cf/234bd3ba6a9c417ab7bb8c89e050f73c 2023-07-11 20:14:20,700 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/.tmp/cf/234bd3ba6a9c417ab7bb8c89e050f73c as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c 2023-07-11 20:14:20,710 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c, entries=4, sequenceid=6, filesize=5.1 K 2023-07-11 20:14:20,715 INFO [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for de387c60cc30442ba85deecfb6960c20 in 42ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:20,715 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-11 20:14:20,715 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de387c60cc30442ba85deecfb6960c20: 2023-07-11 20:14:20,715 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,715 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:20,716 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c] hfiles 2023-07-11 20:14:20,716 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,719 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:20,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:20,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:20,720 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:20,724 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/.tmp/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec 2023-07-11 20:14:20,750 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/.tmp/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec 2023-07-11 20:14:20,756 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec, entries=46, sequenceid=6, filesize=7.9 K 2023-07-11 20:14:20,757 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for fce2fbf3b89d24ac86ac084bfb455f3b in 84ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:20,760 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fce2fbf3b89d24ac86ac084bfb455f3b: 2023-07-11 20:14:20,761 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,762 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:20,762 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec] hfiles 2023-07-11 20:14:20,762 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,767 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. completed. 2023-07-11 20:14:20,767 DEBUG [rs(jenkins-hbase4.apache.org,41061,1689106361927)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:20,767 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:20,767 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:20,767 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,767 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,767 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:14:20,775 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,775 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,775 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,775 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41061,1689106361927': 2023-07-11 20:14:20,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:14:20,837 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. completed. 2023-07-11 20:14:20,837 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:20,837 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:14:20,839 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:20,840 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,840 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,840 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:20,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:14:20,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:14:20,846 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 20:14:20,846 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:20,846 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:20,846 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,846 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:20,848 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,848 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,848 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:20,851 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:20,852 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,853 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:20,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,855 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,855 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,856 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,859 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,859 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,859 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:20,860 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:20,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:20,859 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,860 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:20,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,859 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:20,860 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,863 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:20,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:20,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,921 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:20,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:20,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:20,922 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:20,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 20:14:20,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,977 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:20,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689106460618Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689106460862 (+244 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689106460862Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689106460867 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689106460895 (+28 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689106460977 (+82 ms) 2023-07-11 20:14:20,984 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:20,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 366 msec 2023-07-11 20:14:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:21,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:21,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:21,224 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224 2023-07-11 20:14:21,224 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36637, tgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224, rawTgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:21,260 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:21,260 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_893466371_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:21,260 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-11 20:14:21,267 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:21,322 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,323 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,324 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,324 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,324 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,325 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,325 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,422 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-3646562989878793303.jar 2023-07-11 20:14:21,423 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,425 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,425 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:21,426 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:21,426 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:21,426 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:21,427 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:21,427 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:21,428 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:21,428 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:21,429 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:21,429 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:21,429 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:21,430 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:21,430 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:21,431 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:21,431 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:21,431 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:21,432 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:21,432 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:22,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:22,723 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:22,725 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-11 20:14:22,836 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:22,836 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:23,340 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:24,039 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:28,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:32,171 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:32,172 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:32,188 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:32,188 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:32,189 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:32,189 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:32,189 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 20:14:32,190 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 20:14:32,190 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:32,190 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 20:14:32,190 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106461224/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 20:14:32,196 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106472205"}]},"ts":"1689106472205"} 2023-07-11 20:14:32,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:32,209 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 20:14:32,211 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-11 20:14:32,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, UNASSIGN}] 2023-07-11 20:14:32,214 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, UNASSIGN 2023-07-11 20:14:32,214 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, UNASSIGN 2023-07-11 20:14:32,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=de387c60cc30442ba85deecfb6960c20, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:32,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fce2fbf3b89d24ac86ac084bfb455f3b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:32,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106472214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106472214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106472214"}]},"ts":"1689106472214"} 2023-07-11 20:14:32,215 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106472214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106472214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106472214"}]},"ts":"1689106472214"} 2023-07-11 20:14:32,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure de387c60cc30442ba85deecfb6960c20, server=jenkins-hbase4.apache.org,41061,1689106361927}] 2023-07-11 20:14:32,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fce2fbf3b89d24ac86ac084bfb455f3b, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:32,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fce2fbf3b89d24ac86ac084bfb455f3b, disabling compactions & flushes 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de387c60cc30442ba85deecfb6960c20, disabling compactions & flushes 2023-07-11 20:14:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:32,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. after waiting 0 ms 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:32,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. after waiting 0 ms 2023-07-11 20:14:32,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:32,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:32,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:32,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20. 2023-07-11 20:14:32,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de387c60cc30442ba85deecfb6960c20: 2023-07-11 20:14:32,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:32,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:32,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b. 2023-07-11 20:14:32,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fce2fbf3b89d24ac86ac084bfb455f3b: 2023-07-11 20:14:32,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:32,505 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=de387c60cc30442ba85deecfb6960c20, regionState=CLOSED 2023-07-11 20:14:32,505 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106472504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106472504"}]},"ts":"1689106472504"} 2023-07-11 20:14:32,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:32,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fce2fbf3b89d24ac86ac084bfb455f3b, regionState=CLOSED 2023-07-11 20:14:32,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106472507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106472507"}]},"ts":"1689106472507"} 2023-07-11 20:14:32,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:32,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-11 20:14:32,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure de387c60cc30442ba85deecfb6960c20, server=jenkins-hbase4.apache.org,41061,1689106361927 in 290 msec 2023-07-11 20:14:32,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-11 20:14:32,512 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fce2fbf3b89d24ac86ac084bfb455f3b, server=jenkins-hbase4.apache.org,46545,1689106361876 in 291 msec 2023-07-11 20:14:32,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=de387c60cc30442ba85deecfb6960c20, UNASSIGN in 300 msec 2023-07-11 20:14:32,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-11 20:14:32,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fce2fbf3b89d24ac86ac084bfb455f3b, UNASSIGN in 301 msec 2023-07-11 20:14:32,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106472515"}]},"ts":"1689106472515"} 2023-07-11 20:14:32,518 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 20:14:32,521 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-11 20:14:32,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 328 msec 2023-07-11 20:14:32,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:32,810 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-11 20:14:32,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,819 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,825 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,825 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,825 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,825 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:32,825 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:32,826 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:32,826 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,826 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:32,827 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:32,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-11 20:14:32,827 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:14:32,827 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:32,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 20:14:32,832 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/recovered.edits] 2023-07-11 20:14:32,832 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/recovered.edits] 2023-07-11 20:14:32,837 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/cf/2dd95fdf32ad46b8b5a99a5c07ab8aec 2023-07-11 20:14:32,839 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/cf/234bd3ba6a9c417ab7bb8c89e050f73c 2023-07-11 20:14:32,851 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20/recovered.edits/9.seqid 2023-07-11 20:14:32,852 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/de387c60cc30442ba85deecfb6960c20 2023-07-11 20:14:32,852 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b/recovered.edits/9.seqid 2023-07-11 20:14:32,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testEmptyExportFileSystemState/fce2fbf3b89d24ac86ac084bfb455f3b 2023-07-11 20:14:32,853 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 20:14:32,856 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,858 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-11 20:14:32,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-11 20:14:32,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-11 20:14:32,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106472867"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:32,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106472867"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:32,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:32,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => de387c60cc30442ba85deecfb6960c20, NAME => 'testtb-testEmptyExportFileSystemState,,1689106459181.de387c60cc30442ba85deecfb6960c20.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fce2fbf3b89d24ac86ac084bfb455f3b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106459181.fce2fbf3b89d24ac86ac084bfb455f3b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:32,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-11 20:14:32,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106472883"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:32,885 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-11 20:14:32,890 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:32,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 80 msec 2023-07-11 20:14:32,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 20:14:32,934 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-11 20:14:32,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-11 20:14:32,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:32,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-11 20:14:32,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:33,003 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:39732 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-730332318_1 at /127.0.0.1:34544 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4594 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:32772 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:42374 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:45929 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35481 from appattempt_1689106369686_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-730332318_1 at /127.0.0.1:40034 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 568) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 187), AvailableMemoryMB=1083 (was 1256) 2023-07-11 20:14:33,003 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-11 20:14:33,049 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=181, AvailableMemoryMB=1074 2023-07-11 20:14:33,049 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-11 20:14:33,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:14:33,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,056 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:33,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-11 20:14:33,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:33,062 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:33,070 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,070 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,071 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d empty. 2023-07-11 20:14:33,071 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 empty. 2023-07-11 20:14:33,071 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,072 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,072 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 20:14:33,114 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:33,119 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a74f47a264ccfca899e85646745e872d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:33,128 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 93274c4e2afd18a026997258e14eacd3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 93274c4e2afd18a026997258e14eacd3, disabling compactions & flushes 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a74f47a264ccfca899e85646745e872d, disabling compactions & flushes 2023-07-11 20:14:33,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. after waiting 0 ms 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. after waiting 0 ms 2023-07-11 20:14:33,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 93274c4e2afd18a026997258e14eacd3: 2023-07-11 20:14:33,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a74f47a264ccfca899e85646745e872d: 2023-07-11 20:14:33,157 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:33,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106473158"}]},"ts":"1689106473158"} 2023-07-11 20:14:33,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106473158"}]},"ts":"1689106473158"} 2023-07-11 20:14:33,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:33,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:33,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:33,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106473163"}]},"ts":"1689106473163"} 2023-07-11 20:14:33,164 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-11 20:14:33,175 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:33,176 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:33,176 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:33,176 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:33,177 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:33,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, ASSIGN}] 2023-07-11 20:14:33,179 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, ASSIGN 2023-07-11 20:14:33,180 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, ASSIGN 2023-07-11 20:14:33,180 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46545,1689106361876; forceNewPlan=false, retain=false 2023-07-11 20:14:33,180 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35437,1689106361799; forceNewPlan=false, retain=false 2023-07-11 20:14:33,330 INFO [jenkins-hbase4:38559] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:33,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a74f47a264ccfca899e85646745e872d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=93274c4e2afd18a026997258e14eacd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106473334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106473334"}]},"ts":"1689106473334"} 2023-07-11 20:14:33,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106473334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106473334"}]},"ts":"1689106473334"} 2023-07-11 20:14:33,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure a74f47a264ccfca899e85646745e872d, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:14:33,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 93274c4e2afd18a026997258e14eacd3, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:33,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a74f47a264ccfca899e85646745e872d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:14:33,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. service=AccessControlService 2023-07-11 20:14:33,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93274c4e2afd18a026997258e14eacd3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:14:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. service=AccessControlService 2023-07-11 20:14:33,501 INFO [StoreOpener-a74f47a264ccfca899e85646745e872d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:33,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,503 INFO [StoreOpener-93274c4e2afd18a026997258e14eacd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,503 DEBUG [StoreOpener-a74f47a264ccfca899e85646745e872d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf 2023-07-11 20:14:33,503 DEBUG [StoreOpener-a74f47a264ccfca899e85646745e872d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf 2023-07-11 20:14:33,503 INFO [StoreOpener-a74f47a264ccfca899e85646745e872d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a74f47a264ccfca899e85646745e872d columnFamilyName cf 2023-07-11 20:14:33,504 INFO [StoreOpener-a74f47a264ccfca899e85646745e872d-1] regionserver.HStore(310): Store=a74f47a264ccfca899e85646745e872d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:33,505 DEBUG [StoreOpener-93274c4e2afd18a026997258e14eacd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf 2023-07-11 20:14:33,505 DEBUG [StoreOpener-93274c4e2afd18a026997258e14eacd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf 2023-07-11 20:14:33,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,505 INFO [StoreOpener-93274c4e2afd18a026997258e14eacd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93274c4e2afd18a026997258e14eacd3 columnFamilyName cf 2023-07-11 20:14:33,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,506 INFO [StoreOpener-93274c4e2afd18a026997258e14eacd3-1] regionserver.HStore(310): Store=93274c4e2afd18a026997258e14eacd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:33,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:33,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:33,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:33,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a74f47a264ccfca899e85646745e872d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68016535, jitterRate=0.013525351881980896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:33,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:33,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a74f47a264ccfca899e85646745e872d: 2023-07-11 20:14:33,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93274c4e2afd18a026997258e14eacd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67374926, jitterRate=0.003964632749557495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:33,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93274c4e2afd18a026997258e14eacd3: 2023-07-11 20:14:33,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d., pid=108, masterSystemTime=1689106473491 2023-07-11 20:14:33,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3., pid=109, masterSystemTime=1689106473497 2023-07-11 20:14:33,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,562 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a74f47a264ccfca899e85646745e872d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106473562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106473562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106473562"}]},"ts":"1689106473562"} 2023-07-11 20:14:33,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=93274c4e2afd18a026997258e14eacd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106473562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106473562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106473562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106473562"}]},"ts":"1689106473562"} 2023-07-11 20:14:33,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-11 20:14:33,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure a74f47a264ccfca899e85646745e872d, server=jenkins-hbase4.apache.org,35437,1689106361799 in 225 msec 2023-07-11 20:14:33,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-11 20:14:33,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, ASSIGN in 389 msec 2023-07-11 20:14:33,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 93274c4e2afd18a026997258e14eacd3, server=jenkins-hbase4.apache.org,46545,1689106361876 in 224 msec 2023-07-11 20:14:33,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-11 20:14:33,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, ASSIGN in 390 msec 2023-07-11 20:14:33,569 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:33,569 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106473569"}]},"ts":"1689106473569"} 2023-07-11 20:14:33,571 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-11 20:14:33,573 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:33,573 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-11 20:14:33,575 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:33,576 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:33,576 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:33,576 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:33,576 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:33,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:33,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:33,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:33,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:33,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 527 msec 2023-07-11 20:14:33,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:33,661 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-11 20:14:33,661 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-11 20:14:33,661 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:33,665 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-11 20:14:33,665 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:33,665 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-11 20:14:33,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:33,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106473668 (current time:1689106473668). 2023-07-11 20:14:33,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:33,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x29d16b1d to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:33,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3025ac60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:33,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:33,690 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:33,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29d16b1d to 127.0.0.1:50019 2023-07-11 20:14:33,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:33,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x6c373f02 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:33,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e9c381a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:33,798 DEBUG [hconnection-0x5347db05-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:33,801 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:33,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:33,808 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:33,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c373f02 to 127.0.0.1:50019 2023-07-11 20:14:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:33,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:33,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:33,812 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:33,813 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689107073813 2023-07-11 20:14:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:33,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,814 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:33,814 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:33,815 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:33,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:33,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-11 20:14:33,817 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:33,818 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689107073817 2023-07-11 20:14:33,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,828 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:33,828 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:33,829 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 20:14:33,829 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 20:14:33,830 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,830 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,837 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:33,837 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:33,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:33,837 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,837 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:33,838 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:33,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,839 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:33,840 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:33,842 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:33,842 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:33,842 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:33,842 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:33,848 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,848 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,848 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:33,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:33,848 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,848 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:33,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,849 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:33,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d283655[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:33,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:33,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d283655[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:33,854 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 20:14:33,854 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:33,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:14:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:33,857 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:33,857 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:33,856 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,857 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. started... 2023-07-11 20:14:33,856 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,857 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:33,857 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. started... 2023-07-11 20:14:33,858 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93274c4e2afd18a026997258e14eacd3: 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a74f47a264ccfca899e85646745e872d: 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:33,860 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,860 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:33,860 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:33,860 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:33,915 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:33,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:33,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:33,917 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:33,917 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. completed. 2023-07-11 20:14:33,918 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:33,918 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:33,918 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:33,918 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,918 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:33,918 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:33,921 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:33,921 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:33,922 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:33,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:33,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:33,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:33,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:33,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:33,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:33,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:14:33,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 20:14:34,118 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:34,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:34,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:34,119 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:34,296 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. completed. 2023-07-11 20:14:34,296 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:34,296 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:14:34,298 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:34,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:34,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:34,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:14:34,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 20:14:34,306 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 20:14:34,306 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:34,306 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:34,306 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,307 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:34,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,314 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:34,315 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,315 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,317 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,318 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,319 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:34,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,324 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:34,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,326 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,324 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:34,326 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,326 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:34,327 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,327 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:34,327 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:34,327 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,327 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:34,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,419 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:34,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:34,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:34,421 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:14:34,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 20:14:34,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,436 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689106473813Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106474326 (+513 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106474326Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106474330 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106474356 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689106474436 (+80 ms) 2023-07-11 20:14:34,439 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:34,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 625 msec 2023-07-11 20:14:34,921 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:34,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:34,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46545] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:34,936 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:34,936 DEBUG [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:34,936 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:34,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:34,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106474959 (current time:1689106474959). 2023-07-11 20:14:34,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:34,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x3c3ac5ed to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:34,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5148ae9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:34,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:34,996 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:34,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c3ac5ed to 127.0.0.1:50019 2023-07-11 20:14:34,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:34,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(139): Connect 0x5317b871 to 127.0.0.1:50019 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:35,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39e81a53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:35,009 DEBUG [hconnection-0x2d406fbc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:35,013 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:35,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:35,020 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:35,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5317b871 to 127.0.0.1:50019 2023-07-11 20:14:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:35,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:35,026 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:35,027 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689107075027 2023-07-11 20:14:35,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:35,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:35,030 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:35,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-11 20:14:35,032 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:35,033 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689107075033 2023-07-11 20:14:35,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,053 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:35,053 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:35,055 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 20:14:35,055 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 20:14:35,125 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,125 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,127 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,127 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,128 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:35,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,129 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:35,129 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:35,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,129 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:35,129 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:35,131 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:35,131 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,131 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:35,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,132 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,133 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,133 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,134 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,134 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:35,134 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:35,134 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:35,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,134 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:35,135 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:35,136 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:35,136 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:35,137 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:35,137 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41061,1689106361927' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:35,136 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:35,137 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:35,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:35,140 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,140 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,140 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,140 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,140 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:35,141 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,141 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46545,1689106361876' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781c82ac[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:35,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:35,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35437,1689106361799' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:35,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781c82ac[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:35,148 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 20:14:35,148 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,157 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:35,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:35,158 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:35,158 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. started... 2023-07-11 20:14:35,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,158 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41061,1689106361927' in zk 2023-07-11 20:14:35,158 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93274c4e2afd18a026997258e14eacd3 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-11 20:14:35,158 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:35,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,159 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:35,160 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,160 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:35,161 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:35,161 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:35,161 DEBUG [member: 'jenkins-hbase4.apache.org,41061,1689106361927' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:35,164 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:35,164 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:35,164 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. started... 2023-07-11 20:14:35,164 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a74f47a264ccfca899e85646745e872d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-11 20:14:35,195 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/.tmp/cf/740ac4e521594118ba57c8fb285a76d5 2023-07-11 20:14:35,197 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/.tmp/cf/9809996460a143dc9321a90c7032793c 2023-07-11 20:14:35,202 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/.tmp/cf/740ac4e521594118ba57c8fb285a76d5 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5 2023-07-11 20:14:35,202 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/.tmp/cf/9809996460a143dc9321a90c7032793c as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c 2023-07-11 20:14:35,208 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5, entries=6, sequenceid=6, filesize=5.2 K 2023-07-11 20:14:35,208 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c, entries=44, sequenceid=6, filesize=7.8 K 2023-07-11 20:14:35,209 INFO [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for a74f47a264ccfca899e85646745e872d in 45ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:35,209 INFO [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 93274c4e2afd18a026997258e14eacd3 in 51ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:35,209 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:35,209 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a74f47a264ccfca899e85646745e872d: 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93274c4e2afd18a026997258e14eacd3: 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5] hfiles 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c] hfiles 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,213 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,239 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. completed. 2023-07-11 20:14:35,239 DEBUG [rs(jenkins-hbase4.apache.org,35437,1689106361799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:35,239 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:35,239 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:35,239 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,239 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:35,239 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35437,1689106361799' in zk 2023-07-11 20:14:35,241 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:35,241 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,241 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:35,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:35,241 DEBUG [member: 'jenkins-hbase4.apache.org,35437,1689106361799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:35,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:35,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35437,1689106361799': 2023-07-11 20:14:35,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35437,1689106361799' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 20:14:35,332 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:35,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:35,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:35,334 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:35,634 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:35,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:35,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:35,635 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:14:35,640 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. completed. 2023-07-11 20:14:35,640 DEBUG [rs(jenkins-hbase4.apache.org,46545,1689106361876)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46545,1689106361876' in zk 2023-07-11 20:14:35,646 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,646 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:35,646 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:35,647 DEBUG [member: 'jenkins-hbase4.apache.org,46545,1689106361876' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46545,1689106361876': 2023-07-11 20:14:35,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46545,1689106361876' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 20:14:35,661 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 20:14:35,661 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:35,661 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:35,661 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,661 INFO [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:35,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,668 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:35,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:35,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,670 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,671 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:35,673 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,675 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,676 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,676 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,680 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,680 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,681 DEBUG [(jenkins-hbase4.apache.org,38559,1689106360147)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:35,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,681 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:35,684 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:14:35,685 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,685 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:35,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:35,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:36,136 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:36,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:36,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:36,138 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 20:14:36,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 20:14:36,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:36,231 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:36,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689106475027Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689106475683 (+656 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689106475684 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689106475712 (+28 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689106475748 (+36 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689106476230 (+482 ms) 2023-07-11 20:14:36,236 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:36,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.2080 sec 2023-07-11 20:14:36,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:37,138 DEBUG [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:37,140 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140 2023-07-11 20:14:37,140 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36637, tgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140, rawTgtDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140, srcFsUri=hdfs://localhost:36637, srcDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:37,167 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593 2023-07-11 20:14:37,167 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-478703190_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,167 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36637, inputRoot=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593, snapshotDir=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-11 20:14:37,240 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,283 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,284 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,284 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,285 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,285 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,286 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,286 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,385 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/hadoop-1722921355878048212.jar 2023-07-11 20:14:37,385 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,386 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,386 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,387 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,387 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,388 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:37,388 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:37,389 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:37,389 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:37,390 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:37,390 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:37,391 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:37,391 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:37,392 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:37,392 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:37,394 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:37,395 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:37,395 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:37,396 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:37,396 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:37,397 DEBUG [Listener at jenkins-hbase4.apache.org/35229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:38,081 WARN [Listener at jenkins-hbase4.apache.org/35229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:38,084 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-11 20:14:38,086 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-11 20:14:38,096 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:38,265 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:38,265 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:38,439 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:44,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:46,602 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369686_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:51,594 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:51,594 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:51,646 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,646 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:51,646 INFO [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:51,647 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,647 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 20:14:51,647 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 20:14:51,647 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_991744317_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,648 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 20:14:51,648 DEBUG [Listener at jenkins-hbase4.apache.org/35229] snapshot.TestExportSnapshot(367): hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/export-test/export-1689106477140/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 20:14:51,656 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:51,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106491662"}]},"ts":"1689106491662"} 2023-07-11 20:14:51,663 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-11 20:14:51,665 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-11 20:14:51,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, UNASSIGN}] 2023-07-11 20:14:51,668 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, UNASSIGN 2023-07-11 20:14:51,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, UNASSIGN 2023-07-11 20:14:51,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=93274c4e2afd18a026997258e14eacd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:14:51,671 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a74f47a264ccfca899e85646745e872d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:14:51,672 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106491671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106491671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106491671"}]},"ts":"1689106491671"} 2023-07-11 20:14:51,672 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106491671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106491671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106491671"}]},"ts":"1689106491671"} 2023-07-11 20:14:51,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure a74f47a264ccfca899e85646745e872d, server=jenkins-hbase4.apache.org,35437,1689106361799}] 2023-07-11 20:14:51,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 93274c4e2afd18a026997258e14eacd3, server=jenkins-hbase4.apache.org,46545,1689106361876}] 2023-07-11 20:14:51,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:51,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:51,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a74f47a264ccfca899e85646745e872d, disabling compactions & flushes 2023-07-11 20:14:51,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:51,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:51,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. after waiting 0 ms 2023-07-11 20:14:51,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:51,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:51,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93274c4e2afd18a026997258e14eacd3, disabling compactions & flushes 2023-07-11 20:14:51,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:51,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:51,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. after waiting 0 ms 2023-07-11 20:14:51,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:51,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:51,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:51,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d. 2023-07-11 20:14:51,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a74f47a264ccfca899e85646745e872d: 2023-07-11 20:14:51,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:51,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:51,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3. 2023-07-11 20:14:51,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93274c4e2afd18a026997258e14eacd3: 2023-07-11 20:14:51,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:51,843 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a74f47a264ccfca899e85646745e872d, regionState=CLOSED 2023-07-11 20:14:51,843 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106491843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106491843"}]},"ts":"1689106491843"} 2023-07-11 20:14:51,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:51,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=93274c4e2afd18a026997258e14eacd3, regionState=CLOSED 2023-07-11 20:14:51,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106491844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106491844"}]},"ts":"1689106491844"} 2023-07-11 20:14:51,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-11 20:14:51,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure a74f47a264ccfca899e85646745e872d, server=jenkins-hbase4.apache.org,35437,1689106361799 in 172 msec 2023-07-11 20:14:51,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 20:14:51,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 93274c4e2afd18a026997258e14eacd3, server=jenkins-hbase4.apache.org,46545,1689106361876 in 171 msec 2023-07-11 20:14:51,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a74f47a264ccfca899e85646745e872d, UNASSIGN in 181 msec 2023-07-11 20:14:51,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-11 20:14:51,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=93274c4e2afd18a026997258e14eacd3, UNASSIGN in 182 msec 2023-07-11 20:14:51,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106491850"}]},"ts":"1689106491850"} 2023-07-11 20:14:51,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-11 20:14:51,853 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-11 20:14:51,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-11 20:14:51,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:51,964 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-11 20:14:51,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,971 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,975 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:51,976 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,976 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,976 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,976 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:51,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:51,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:51,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:51,978 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:51,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 20:14:51,981 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/recovered.edits] 2023-07-11 20:14:51,983 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:51,988 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5 to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/cf/740ac4e521594118ba57c8fb285a76d5 2023-07-11 20:14:51,992 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d/recovered.edits/9.seqid 2023-07-11 20:14:51,993 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a74f47a264ccfca899e85646745e872d 2023-07-11 20:14:52,002 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf, FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/recovered.edits] 2023-07-11 20:14:52,008 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/cf/9809996460a143dc9321a90c7032793c 2023-07-11 20:14:52,012 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/recovered.edits/9.seqid to hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3/recovered.edits/9.seqid 2023-07-11 20:14:52,012 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/93274c4e2afd18a026997258e14eacd3 2023-07-11 20:14:52,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 20:14:52,015 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:52,020 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-11 20:14:52,027 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-11 20:14:52,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:52,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-11 20:14:52,028 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106492028"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:52,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106492028"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:52,031 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:52,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a74f47a264ccfca899e85646745e872d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106473051.a74f47a264ccfca899e85646745e872d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 93274c4e2afd18a026997258e14eacd3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106473051.93274c4e2afd18a026997258e14eacd3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:52,031 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-11 20:14:52,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106492031"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:52,039 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-11 20:14:52,041 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:52,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-11 20:14:52,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 20:14:52,081 INFO [Listener at jenkins-hbase4.apache.org/35229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-11 20:14:52,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 20:14:52,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:52,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 20:14:52,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38559] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:52,139 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 762) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_176137379_1 at /127.0.0.1:37010 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_176137379_1 at /127.0.0.1:49608 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:46262 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:53188 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_991744317_17 at /127.0.0.1:37824 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:33183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb663b0-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5200 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=903 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=717 (was 684) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=231 (was 1074) 2023-07-11 20:14:52,139 WARN [Listener at jenkins-hbase4.apache.org/35229] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-11 20:14:52,139 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-11 20:14:52,172 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:14:52,313 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689106369686_0007_01_000001 is : 143 2023-07-11 20:14:57,437 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:15:06,296 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:20,420 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:20,421 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:20,439 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-11 20:15:20,453 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-11 20:15:20,454 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:20,486 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:20,495 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:20,495 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-11 20:15:20,495 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 20:15:20,496 INFO [Listener at jenkins-hbase4.apache.org/35229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 20:15:20,496 DEBUG [Listener at jenkins-hbase4.apache.org/35229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68214c6c to 127.0.0.1:50019 2023-07-11 20:15:20,496 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 20:15:20,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] util.JVMClusterUtil(257): Found active master hash=1241008609, stopped=false 2023-07-11 20:15:20,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,497 DEBUG [Listener at jenkins-hbase4.apache.org/35229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 20:15:20,498 INFO [Listener at jenkins-hbase4.apache.org/35229] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:15:20,500 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:20,500 INFO [Listener at jenkins-hbase4.apache.org/35229] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:15:20,500 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:20,500 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:20,500 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:20,502 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:15:20,502 DEBUG [Listener at jenkins-hbase4.apache.org/35229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7000d2f6 to 127.0.0.1:50019 2023-07-11 20:15:20,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:20,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:20,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:20,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:20,502 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1064): Closing user regions 2023-07-11 20:15:20,503 DEBUG [Listener at jenkins-hbase4.apache.org/35229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,503 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35437,1689106361799' ***** 2023-07-11 20:15:20,504 DEBUG [Listener at jenkins-hbase4.apache.org/35229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,504 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:20,504 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46545,1689106361876' ***** 2023-07-11 20:15:20,504 DEBUG [Listener at jenkins-hbase4.apache.org/35229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,504 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:20,504 INFO [RS:0;jenkins-hbase4:35437] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:20,504 INFO [RS:0;jenkins-hbase4:35437] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:20,504 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:20,504 INFO [RS:0;jenkins-hbase4:35437] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:20,505 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:15:20,505 DEBUG [RS:0;jenkins-hbase4:35437] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01fdae2a to 127.0.0.1:50019 2023-07-11 20:15:20,505 DEBUG [RS:0;jenkins-hbase4:35437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,505 INFO [RS:1;jenkins-hbase4:46545] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:20,513 INFO [RS:1;jenkins-hbase4:46545] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:20,513 INFO [RS:1;jenkins-hbase4:46545] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:20,513 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:15:20,513 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,513 DEBUG [RS:1;jenkins-hbase4:46545] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7aba686b to 127.0.0.1:50019 2023-07-11 20:15:20,513 DEBUG [RS:1;jenkins-hbase4:46545] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,513 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:20,513 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41061,1689106361927' ***** 2023-07-11 20:15:20,514 DEBUG [Listener at jenkins-hbase4.apache.org/35229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,514 INFO [Listener at jenkins-hbase4.apache.org/35229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:20,514 INFO [RS:2;jenkins-hbase4:41061] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:20,514 INFO [RS:2;jenkins-hbase4:41061] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:20,514 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:20,514 INFO [RS:2;jenkins-hbase4:41061] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:20,515 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(3305): Received CLOSE for 2617bd4e887dedc964015774fd780f4a 2023-07-11 20:15:20,515 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(3305): Received CLOSE for f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:15:20,515 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:15:20,515 DEBUG [RS:2;jenkins-hbase4:41061] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f647398 to 127.0.0.1:50019 2023-07-11 20:15:20,515 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,515 DEBUG [RS:2;jenkins-hbase4:41061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,521 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,522 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46545,1689106361876; all regions closed. 2023-07-11 20:15:20,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2617bd4e887dedc964015774fd780f4a, disabling compactions & flushes 2023-07-11 20:15:20,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:15:20,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:15:20,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. after waiting 0 ms 2023-07-11 20:15:20,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:15:20,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2617bd4e887dedc964015774fd780f4a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-11 20:15:20,523 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-11 20:15:20,523 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1478): Online Regions={2617bd4e887dedc964015774fd780f4a=hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a., f8f2682993679ca00be6ddc6853bf014=hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014.} 2023-07-11 20:15:20,524 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1504): Waiting on 2617bd4e887dedc964015774fd780f4a, f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:15:20,534 INFO [RS:0;jenkins-hbase4:35437] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:20,536 INFO [RS:0;jenkins-hbase4:35437] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:20,536 INFO [RS:0;jenkins-hbase4:35437] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:20,536 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 20:15:20,537 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 20:15:20,537 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-11 20:15:20,537 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 20:15:20,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:15:20,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:15:20,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:15:20,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:15:20,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:15:20,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-11 20:15:20,576 DEBUG [RS:1;jenkins-hbase4:46545] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs 2023-07-11 20:15:20,576 INFO [RS:1;jenkins-hbase4:46545] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46545%2C1689106361876:(num 1689106364097) 2023-07-11 20:15:20,576 DEBUG [RS:1;jenkins-hbase4:46545] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,576 INFO [RS:1;jenkins-hbase4:46545] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,611 INFO [RS:1;jenkins-hbase4:46545] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:20,613 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:20,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/.tmp/l/5a5bb3712bbe4ec59edb5588204129cb 2023-07-11 20:15:20,635 INFO [RS:1;jenkins-hbase4:46545] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:20,635 INFO [RS:1;jenkins-hbase4:46545] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:20,635 INFO [RS:1;jenkins-hbase4:46545] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:20,636 INFO [RS:1;jenkins-hbase4:46545] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46545 2023-07-11 20:15:20,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5bb3712bbe4ec59edb5588204129cb 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,643 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46545,1689106361876 2023-07-11 20:15:20,644 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/.tmp/l/5a5bb3712bbe4ec59edb5588204129cb as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/l/5a5bb3712bbe4ec59edb5588204129cb 2023-07-11 20:15:20,644 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46545,1689106361876] 2023-07-11 20:15:20,645 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46545,1689106361876; numProcessing=1 2023-07-11 20:15:20,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/info/bd01531103ea46e6add3183ec3b5fb7e 2023-07-11 20:15:20,648 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46545,1689106361876 already deleted, retry=false 2023-07-11 20:15:20,648 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46545,1689106361876 expired; onlineServers=2 2023-07-11 20:15:20,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd01531103ea46e6add3183ec3b5fb7e 2023-07-11 20:15:20,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a5bb3712bbe4ec59edb5588204129cb 2023-07-11 20:15:20,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/l/5a5bb3712bbe4ec59edb5588204129cb, entries=7, sequenceid=18, filesize=5.2 K 2023-07-11 20:15:20,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2617bd4e887dedc964015774fd780f4a in 129ms, sequenceid=18, compaction requested=false 2023-07-11 20:15:20,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/acl/2617bd4e887dedc964015774fd780f4a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-11 20:15:20,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:15:20,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2617bd4e887dedc964015774fd780f4a: 2023-07-11 20:15:20,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689106365573.2617bd4e887dedc964015774fd780f4a. 2023-07-11 20:15:20,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f8f2682993679ca00be6ddc6853bf014, disabling compactions & flushes 2023-07-11 20:15:20,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:15:20,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:15:20,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. after waiting 0 ms 2023-07-11 20:15:20,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:15:20,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f8f2682993679ca00be6ddc6853bf014 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 20:15:20,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/rep_barrier/9c090369f46642939fe2ca46fd3bb532 2023-07-11 20:15:20,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c090369f46642939fe2ca46fd3bb532 2023-07-11 20:15:20,724 DEBUG [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1504): Waiting on f8f2682993679ca00be6ddc6853bf014 2023-07-11 20:15:20,737 DEBUG [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 20:15:20,746 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:20,746 INFO [RS:1;jenkins-hbase4:46545] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46545,1689106361876; zookeeper connection closed. 2023-07-11 20:15:20,746 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:46545-0x1015604266f0002, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:20,756 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6bdabd14] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6bdabd14 2023-07-11 20:15:20,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/.tmp/info/4207167873ac42c4b50ad8ff09a5aab2 2023-07-11 20:15:20,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/.tmp/info/4207167873ac42c4b50ad8ff09a5aab2 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/info/4207167873ac42c4b50ad8ff09a5aab2 2023-07-11 20:15:20,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/table/ee5047f92b5c4749a1dcf90ce1b01c2a 2023-07-11 20:15:20,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/info/4207167873ac42c4b50ad8ff09a5aab2, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 20:15:20,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f8f2682993679ca00be6ddc6853bf014 in 97ms, sequenceid=6, compaction requested=false 2023-07-11 20:15:20,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee5047f92b5c4749a1dcf90ce1b01c2a 2023-07-11 20:15:20,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/info/bd01531103ea46e6add3183ec3b5fb7e as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/info/bd01531103ea46e6add3183ec3b5fb7e 2023-07-11 20:15:20,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd01531103ea46e6add3183ec3b5fb7e 2023-07-11 20:15:20,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/info/bd01531103ea46e6add3183ec3b5fb7e, entries=48, sequenceid=131, filesize=10.3 K 2023-07-11 20:15:20,796 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/rep_barrier/9c090369f46642939fe2ca46fd3bb532 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/rep_barrier/9c090369f46642939fe2ca46fd3bb532 2023-07-11 20:15:20,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/namespace/f8f2682993679ca00be6ddc6853bf014/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:15:20,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:15:20,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f8f2682993679ca00be6ddc6853bf014: 2023-07-11 20:15:20,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689106364729.f8f2682993679ca00be6ddc6853bf014. 2023-07-11 20:15:20,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c090369f46642939fe2ca46fd3bb532 2023-07-11 20:15:20,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/rep_barrier/9c090369f46642939fe2ca46fd3bb532, entries=13, sequenceid=131, filesize=6.4 K 2023-07-11 20:15:20,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/.tmp/table/ee5047f92b5c4749a1dcf90ce1b01c2a as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/table/ee5047f92b5c4749a1dcf90ce1b01c2a 2023-07-11 20:15:20,841 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee5047f92b5c4749a1dcf90ce1b01c2a 2023-07-11 20:15:20,841 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/table/ee5047f92b5c4749a1dcf90ce1b01c2a, entries=24, sequenceid=131, filesize=6.9 K 2023-07-11 20:15:20,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 304ms, sequenceid=131, compaction requested=false 2023-07-11 20:15:20,869 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-11 20:15:20,870 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:20,873 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:15:20,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:15:20,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:15:20,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 20:15:20,884 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 20:15:20,884 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 20:15:20,892 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 20:15:20,892 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 20:15:20,925 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41061,1689106361927; all regions closed. 2023-07-11 20:15:20,938 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35437,1689106361799; all regions closed. 2023-07-11 20:15:20,946 DEBUG [RS:2;jenkins-hbase4:41061] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs 2023-07-11 20:15:20,946 INFO [RS:2;jenkins-hbase4:41061] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41061%2C1689106361927:(num 1689106364100) 2023-07-11 20:15:20,946 DEBUG [RS:2;jenkins-hbase4:41061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,946 INFO [RS:2;jenkins-hbase4:41061] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,947 INFO [RS:2;jenkins-hbase4:41061] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:20,947 INFO [RS:2;jenkins-hbase4:41061] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:20,947 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:20,948 INFO [RS:2;jenkins-hbase4:41061] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:20,948 INFO [RS:2;jenkins-hbase4:41061] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:20,949 INFO [RS:2;jenkins-hbase4:41061] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41061 2023-07-11 20:15:20,950 DEBUG [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs 2023-07-11 20:15:20,950 INFO [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35437%2C1689106361799.meta:.meta(num 1689106364365) 2023-07-11 20:15:20,950 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,950 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:15:20,950 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41061,1689106361927 2023-07-11 20:15:20,951 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41061,1689106361927] 2023-07-11 20:15:20,951 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41061,1689106361927; numProcessing=2 2023-07-11 20:15:20,953 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41061,1689106361927 already deleted, retry=false 2023-07-11 20:15:20,953 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41061,1689106361927 expired; onlineServers=1 2023-07-11 20:15:20,956 DEBUG [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/oldWALs 2023-07-11 20:15:20,956 INFO [RS:0;jenkins-hbase4:35437] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35437%2C1689106361799:(num 1689106364108) 2023-07-11 20:15:20,956 DEBUG [RS:0;jenkins-hbase4:35437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,956 INFO [RS:0;jenkins-hbase4:35437] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:20,956 INFO [RS:0;jenkins-hbase4:35437] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:20,956 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:20,957 INFO [RS:0;jenkins-hbase4:35437] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35437 2023-07-11 20:15:20,960 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35437,1689106361799 2023-07-11 20:15:20,960 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:20,961 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35437,1689106361799] 2023-07-11 20:15:20,961 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35437,1689106361799; numProcessing=3 2023-07-11 20:15:20,962 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35437,1689106361799 already deleted, retry=false 2023-07-11 20:15:20,962 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35437,1689106361799 expired; onlineServers=0 2023-07-11 20:15:20,962 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38559,1689106360147' ***** 2023-07-11 20:15:20,962 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 20:15:20,963 DEBUG [M:0;jenkins-hbase4:38559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c543da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:15:20,963 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38559,1689106360147 2023-07-11 20:15:20,963 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38559,1689106360147; all regions closed. 2023-07-11 20:15:20,963 DEBUG [M:0;jenkins-hbase4:38559] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:20,963 DEBUG [M:0;jenkins-hbase4:38559] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 20:15:20,963 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 20:15:20,963 DEBUG [M:0;jenkins-hbase4:38559] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 20:15:20,963 INFO [M:0;jenkins-hbase4:38559] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 20:15:20,963 INFO [M:0;jenkins-hbase4:38559] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 20:15:20,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363544] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363544,5,FailOnTimeoutGroup] 2023-07-11 20:15:20,963 INFO [M:0;jenkins-hbase4:38559] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-11 20:15:20,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363549] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363549,5,FailOnTimeoutGroup] 2023-07-11 20:15:20,964 DEBUG [M:0;jenkins-hbase4:38559] master.HMaster(1512): Stopping service threads 2023-07-11 20:15:20,964 INFO [M:0;jenkins-hbase4:38559] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 20:15:20,964 ERROR [M:0;jenkins-hbase4:38559] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 20:15:20,964 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-11 20:15:20,964 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:15:20,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:15:20,965 INFO [M:0;jenkins-hbase4:38559] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:15:20,965 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 20:15:20,965 DEBUG [M:0;jenkins-hbase4:38559] zookeeper.ZKUtil(398): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 20:15:20,965 WARN [M:0;jenkins-hbase4:38559] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 20:15:20,965 INFO [M:0;jenkins-hbase4:38559] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:15:20,966 INFO [M:0;jenkins-hbase4:38559] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 20:15:20,966 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:15:20,967 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:20,967 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:20,967 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:15:20,967 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:20,967 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.60 KB 2023-07-11 20:15:21,025 INFO [M:0;jenkins-hbase4:38559] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bdf640a0299b4036a9c1d7d4beb700b6 2023-07-11 20:15:21,031 INFO [M:0;jenkins-hbase4:38559] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdf640a0299b4036a9c1d7d4beb700b6 2023-07-11 20:15:21,032 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bdf640a0299b4036a9c1d7d4beb700b6 as hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bdf640a0299b4036a9c1d7d4beb700b6 2023-07-11 20:15:21,040 INFO [M:0;jenkins-hbase4:38559] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdf640a0299b4036a9c1d7d4beb700b6 2023-07-11 20:15:21,040 INFO [M:0;jenkins-hbase4:38559] regionserver.HStore(1080): Added hdfs://localhost:36637/user/jenkins/test-data/013aa19b-8629-3c16-f764-e28f3fcef593/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bdf640a0299b4036a9c1d7d4beb700b6, entries=119, sequenceid=899, filesize=28.5 K 2023-07-11 20:15:21,041 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382307, heapSize ~449.59 KB/460376, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 74ms, sequenceid=899, compaction requested=false 2023-07-11 20:15:21,043 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:21,043 DEBUG [M:0;jenkins-hbase4:38559] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:15:21,053 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,053 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:41061-0x1015604266f0003, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,053 INFO [RS:2;jenkins-hbase4:41061] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41061,1689106361927; zookeeper connection closed. 2023-07-11 20:15:21,059 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@21a9b9ed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@21a9b9ed 2023-07-11 20:15:21,072 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:21,072 INFO [M:0;jenkins-hbase4:38559] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 20:15:21,073 INFO [M:0;jenkins-hbase4:38559] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38559 2023-07-11 20:15:21,076 DEBUG [M:0;jenkins-hbase4:38559] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38559,1689106360147 already deleted, retry=false 2023-07-11 20:15:21,154 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,154 INFO [RS:0;jenkins-hbase4:35437] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35437,1689106361799; zookeeper connection closed. 2023-07-11 20:15:21,154 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): regionserver:35437-0x1015604266f0001, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,154 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@466ed2c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@466ed2c6 2023-07-11 20:15:21,155 INFO [Listener at jenkins-hbase4.apache.org/35229] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 20:15:21,254 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,254 INFO [M:0;jenkins-hbase4:38559] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38559,1689106360147; zookeeper connection closed. 2023-07-11 20:15:21,254 DEBUG [Listener at localhost/37483-EventThread] zookeeper.ZKWatcher(600): master:38559-0x1015604266f0000, quorum=127.0.0.1:50019, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:21,256 WARN [Listener at jenkins-hbase4.apache.org/35229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:21,259 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:21,364 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:21,364 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-118062964-172.31.14.131-1689106356066 (Datanode Uuid 1c858034-b24b-4dfb-8890-09bcc53afbe9) service to localhost/127.0.0.1:36637 2023-07-11 20:15:21,365 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data5/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,366 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data6/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,367 WARN [Listener at jenkins-hbase4.apache.org/35229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:21,369 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:21,471 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:21,471 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-118062964-172.31.14.131-1689106356066 (Datanode Uuid 16c9c23a-b701-4d89-b638-4bced55da3d0) service to localhost/127.0.0.1:36637 2023-07-11 20:15:21,473 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data3/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data4/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,475 WARN [Listener at jenkins-hbase4.apache.org/35229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:21,478 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:21,581 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:21,581 WARN [BP-118062964-172.31.14.131-1689106356066 heartbeating to localhost/127.0.0.1:36637] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-118062964-172.31.14.131-1689106356066 (Datanode Uuid cc5ed67c-4cc6-407a-b895-14e82addc06a) service to localhost/127.0.0.1:36637 2023-07-11 20:15:21,582 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data1/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,582 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7957d2e7-be6f-4d52-07b9-08d7510e4d39/cluster_725d0f76-0ce1-b3c2-22e2-561b3c6f2b1d/dfs/data/data2/current/BP-118062964-172.31.14.131-1689106356066] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:21,607 INFO [Listener at jenkins-hbase4.apache.org/35229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:21,733 INFO [Listener at jenkins-hbase4.apache.org/35229] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 20:15:21,810 INFO [Listener at jenkins-hbase4.apache.org/35229] hbase.HBaseTestingUtility(1293): Minicluster is down